apps/FastDeploy
1
0
Fork 0
mirror of https://github.com/PaddlePaddle/FastDeploy.git synced 2025-11-01 12:22:53 +08:00
Code Issues Actions 6 Packages Projects Releases Wiki Activity

add x1 a3b quantization (#4397)

Browse Source
This commit is contained in:
tianlef
2025-10-14 15:04:06 +08:00
committed by GitHub
parent 73c8e0849f
commit 14eb8b4f8b
1 changed files with 1 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

1
benchmarks/yaml/x1-a3b-128k-wint8-h800-tp1.yaml
View File

@@ -4,3 +4,4 @@ max_num_seqs: 32
reasoning_parser: ernie_x1
tool_call_parser: ernie_x1
load_choices: "default_v1"
quantization: wint8