apps/FastDeploy
1
0
Fork 0
mirror of https://github.com/PaddlePaddle/FastDeploy.git synced 2025-12-24 13:28:13 +08:00
Code Issues Actions 2 Packages Projects Releases Wiki Activity

[Graph Optimization] SOT+CUDAGraph support ERNIE4.5T VL 28B / 424B (#4645)

Browse Source 
* 45TVL support sot+CUDAGraph

* mv unitest from ce_deploy 2 e2e

* add test_EB_VL_Lite_sot_serving

* rm useless line

* add openai_client

* fix unitest && reduce computing resources
This commit is contained in:
Ryan
2025-10-31 11:38:43 +08:00
committed by GitHub
parent 937bcfc6ed
commit 28de91b50f
3 changed files with 454 additions and 4 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
benchmarks/benchmark_serving.py
View File

@@ -982,7 +982,7 @@ def main(args: argparse.Namespace):
if args.result_dir:
file_name = os.path.join(args.result_dir, file_name)
with open(file_name, "w", encoding="utf-8") as outfile:
json.dump(result_json, outfile)
json.dump(result_json, outfile, ensure_ascii=False)
save_to_pytorch_benchmark_format(args, result_json, file_name)