mirror of
https://github.com/PaddlePaddle/FastDeploy.git
synced 2025-12-24 13:28:13 +08:00
27 lines
1.4 KiB
Markdown
27 lines
1.4 KiB
Markdown
# complete: Text Completion Generation
|
|
|
|
`fastdeploy complete` generates text completions based on a given prompt.
|
|
|
|
## Parameters
|
|
|
|
| Parameter | Description | Default |
|
|
| --------------- | ------------------------------------------------------------------ | ---------------------------------------------------- |
|
|
| --url | URL of the running OpenAI-compatible RESTful API server | [http://localhost:8000/v1](http://localhost:8000/v1) |
|
|
| --model-name | Name of the model used for prompt completion | None |
|
|
| --api-key | API key for OpenAI services | None |
|
|
| --system-prompt | Specifies the system prompt used in the chat template | None |
|
|
| -q, --quick | Sends a single prompt as a MESSAGE, prints the response, and exits | None |
|
|
|
|
## Examples
|
|
|
|
```
|
|
# Connect directly to a local API
|
|
fastdeploy complete
|
|
|
|
# Specify an API URL
|
|
fastdeploy complete --url http://{fastdeploy-serve-host}:{fastdeploy-serve-port}/v1
|
|
|
|
# Generate a quick completion
|
|
fastdeploy complete --quick "The future of AI is"
|
|
```
|