FastDeploy/docs/cli/serve.md

serve: API Service Deployment

fastdeploy serve provides service deployment compatible with the OpenAI API protocol.

Parameters

The following table lists the available options:

Option	Description	Default
--config	Read CLI options from a configuration file (YAML format)	None

For more parameter details, see: FastDeploy Parameter Documentation

Examples

# Start the FastDeploy API server
fastdeploy serve --model baidu/ERNIE-4.5-0.3B-Paddle

# Start the server with a specified port
fastdeploy serve --model baidu/ERNIE-4.5-0.3B-Paddle --port 8000