apps/FastDeploy
1
0
Fork 0
mirror of https://github.com/PaddlePaddle/FastDeploy.git synced 2025-12-24 13:28:13 +08:00
Code Issues Actions 2 Packages Projects Releases Wiki Activity

x1_a3b config (#4135)

Browse Source
This commit is contained in:
tianlef
2025-09-16 19:44:46 +08:00
committed by GitHub
parent d682c97dd3
commit e79a1a7938
1 changed files with 2 additions and 2 deletions
Download Patch File Download Diff File Expand all files Collapse all files

4
benchmarks/yaml/x1-a3b-128k-wint8-h800-tp1.yaml
View File

@@ -1,6 +1,6 @@
or_parallel_size: 1 tensor_parallel_size: 1
max_model_len: 131072 max_model_len: 131072
max_num_seqs: 32 max_num_seqs: 32
quantization: wint8
reasoning_parser: ernie_x1 reasoning_parser: ernie_x1
tool_call_parser: ernie_x1 tool_call_parser: ernie_x1
load_choices: "default_v1"