From ec7746bd5525f20f4b9b3829515d56bc8d34dd9e Mon Sep 17 00:00:00 2001 From: Jiang-Jia-Jun <163579578+Jiang-Jia-Jun@users.noreply.github.com> Date: Thu, 30 Oct 2025 16:40:30 +0800 Subject: [PATCH] Update multi-node_deployment.md --- docs/features/multi-node_deployment.md | 2 ++ 1 file changed, 2 insertions(+) diff --git a/docs/features/multi-node_deployment.md b/docs/features/multi-node_deployment.md index e6c04cc82..cf0920058 100644 --- a/docs/features/multi-node_deployment.md +++ b/docs/features/multi-node_deployment.md @@ -26,6 +26,7 @@ We recommend using mpirun for one-command startup without manually starting each 4. Ensure all nodes can resolve each other's hostnames * Online inference startup example: + ```shell python -m fastdeploy.entrypoints.openai.api_server \ --model baidu/ERNIE-4.5-300B-A47B-Paddle \ @@ -39,6 +40,7 @@ We recommend using mpirun for one-command startup without manually starting each ``` * Offline startup example: + ```python from fastdeploy.engine.sampling_params import SamplingParams from fastdeploy.entrypoints.llm import LLM