mirror of
https://github.com/PaddlePaddle/FastDeploy.git
synced 2025-09-26 20:41:53 +08:00
05c670e593
* [Sync] Update to latest code * Add new code files * Add new code files * update code * Try to fix build.sh * Try to fix build.sh * Update code * Update requirements.txt * Update code --------- Co-authored-by: Jiang-Jia-Jun <jiangjiajun@baidu.com>
5 lines
105 B
YAML
5 lines
105 B
YAML
model: "baidu/paddle_internal/ERNIE-45-Turbo"
|
|
max_model_len: 32768
|
|
max_num_seqs: 128
|
|
kv_cache_ratio: 0.5
|