apps/FastDeploy
1
0
Fork 0
mirror of https://github.com/PaddlePaddle/FastDeploy.git synced 2025-12-24 13:28:13 +08:00
Code Issues Actions 2 Packages Projects Releases Wiki Activity

新增vLLM默认请求参数yaml

Browse Source
This commit is contained in:
ophilia-lee
2025-07-15 17:41:10 +08:00
committed by Zhang Yulong
parent 9d6a42b334
commit 33db137d0b
1 changed files with 11 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

11
benchmarks/yaml/request_yaml/vLLM_default.yaml Normal file
View File

@@ -0,0 +1,11 @@
top_p: 1.0
temperature: 1.0
metadata:
min_tokens: 1
max_tokens: 30721
repetition_penalty: 1.0
frequency_penalty: 0
presence_penalty: 0
skip_special_tokens: false
chat_template_kwargs:
enable_thinking: true