apps/FastDeploy
1
0
Fork 0
mirror of https://github.com/PaddlePaddle/FastDeploy.git synced 2025-12-24 13:28:13 +08:00
Code Issues Actions 2 Packages Projects Releases Wiki Activity
Files
c415885a94da83787f8ec9a0af4e9ef00e87c410
FastDeploy/tests/ce/deploy/21b_sot.yaml
Ryan a5b4866ff1 [CudaGraph][SOT] Add unit tests for splitting the static graph into piecewise graphs that support cuda_graph (#3590) 
* add unitest

* change sot_warmup_sizes

* wtf; add missed commit
2025-08-26 11:25:04 +08:00

9 lines
184 B
YAML
Raw Blame History

max_model_len: 32768
max_num_seqs: 128
tensor_parallel_size: 1
quantization: wint4
use_cudagraph: True
graph_optimization_config:
graph_opt_level: 1
sot_warmup_sizes: [2,16,32,64]
Reference in New Issue View Git Blame Copy Permalink