apps/FastDeploy
1
0
Fork 0
mirror of https://github.com/PaddlePaddle/FastDeploy.git synced 2025-12-24 13:28:13 +08:00
Code Issues Actions 2 Packages Projects Releases Wiki Activity

Update README.md
Some checks failed
Deploy GitHub Pages / deploy (push) Has been cancelled
Details

Browse Source
This commit is contained in:
Jiang-Jia-Jun
2025-07-02 10:04:58 +08:00
committed by GitHub
parent e3aac0c5b8
commit 9f4a65d817
1 changed files with 3 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

4
docs/online_serving/README.md
View File

@@ -52,6 +52,7 @@ For a description of the OpenAI protocol, refer to the document [OpenAI Chat Com
## Parameter Differences
### Request Parameter Differences
The differences in request parameters between FastDeploy and the OpenAI protocol are as follows. Other request parameters will be ignored:
- `prompt` (supported only in the `v1/completions` interface)
- `messages` (supported only in the `v1/chat/completions` interface)
- `frequency_penalty`: Optional[float] = 0.0
@@ -77,6 +78,7 @@ The additional return fields added by FastDeploy are as follows:
- `reasoning_content`: The returned result of the reasoning chain
Overview of return parameters:
```python
ChatCompletionStreamResponse:
id: str
@@ -94,4 +96,4 @@ DeltaMessage:
content: Optional[str] = None
token_ids: Optional[List[int]] = None
reasoning_content: Optional[str] = None
```
```