Update multi-node_deployment.md

This commit is contained in:
Jiang-Jia-Jun
2025-10-30 16:40:30 +08:00
committed by GitHub
parent ca52cadd74
commit ec7746bd55

View File

@@ -26,6 +26,7 @@ We recommend using mpirun for one-command startup without manually starting each
4. Ensure all nodes can resolve each other's hostnames
* Online inference startup example:
```shell
python -m fastdeploy.entrypoints.openai.api_server \
--model baidu/ERNIE-4.5-300B-A47B-Paddle \
@@ -39,6 +40,7 @@ We recommend using mpirun for one-command startup without manually starting each
```
* Offline startup example:
```python
from fastdeploy.engine.sampling_params import SamplingParams
from fastdeploy.entrypoints.llm import LLM