diff --git a/docs/features/multi-node_deployment.md b/docs/features/multi-node_deployment.md index e6c04cc82..cf0920058 100644 --- a/docs/features/multi-node_deployment.md +++ b/docs/features/multi-node_deployment.md @@ -26,6 +26,7 @@ We recommend using mpirun for one-command startup without manually starting each 4. Ensure all nodes can resolve each other's hostnames * Online inference startup example: + ```shell python -m fastdeploy.entrypoints.openai.api_server \ --model baidu/ERNIE-4.5-300B-A47B-Paddle \ @@ -39,6 +40,7 @@ We recommend using mpirun for one-command startup without manually starting each ``` * Offline startup example: + ```python from fastdeploy.engine.sampling_params import SamplingParams from fastdeploy.entrypoints.llm import LLM