apps/FastDeploy
1
0
Fork 0
mirror of https://github.com/PaddlePaddle/FastDeploy.git synced 2025-12-24 13:28:13 +08:00
Code Issues Actions 2 Packages Projects Releases Wiki Activity

benchmark工具适配SGLang框架 (#4607)

Browse Source 
* benchmark工具适配SGLang框架

* benchmark工具适配SGLang框架

* benchmark工具适配SGLang框架
This commit is contained in:
ophilia-lee
2025-10-27 18:52:56 +08:00
committed by GitHub
parent c91c5040c4
commit 70aa7423f8
3 changed files with 17 additions and 13 deletions
Download Patch File Download Diff File Expand all files Collapse all files

14
benchmarks/yaml/request_yaml/vLLM_default.yaml → benchmarks/yaml/request_yaml/request.yaml
View File

@@ -1,11 +1,11 @@
top_p: 1.0
temperature: 1.0
metadata:
min_tokens: 1
max_tokens: 30721
top_p: 0.8
temperature: 0.8
max_tokens: 12288
repetition_penalty: 1.0
frequency_penalty: 0
presence_penalty: 0
skip_special_tokens: false
metadata:
enable_thinking: false
min_tokens: 1
chat_template_kwargs:
enable_thinking: true
enable_thinking: false