Update multi-node_deployment.md

This commit is contained in:
Jiang-Jia-Jun
2025-10-30 16:40:08 +08:00
committed by GitHub
parent 8b9c9463cd
commit ca52cadd74

View File

@@ -26,6 +26,7 @@
4. 确保所有节点能够解析彼此的主机名
* 在线推理启动示例:
```shell
python -m fastdeploy.entrypoints.openai.api_server \
--model baidu/ERNIE-4.5-300B-A47B-Paddle \
@@ -39,6 +40,7 @@
```
* 离线启动示例:
```python
from fastdeploy.engine.sampling_params import SamplingParams
from fastdeploy.entrypoints.llm import LLM