apps/FastDeploy
1
0
Fork 0
mirror of https://github.com/PaddlePaddle/FastDeploy.git synced 2025-09-26 20:41:53 +08:00
Code Issues Actions 5 Packages Projects Releases Wiki Activity
Files
develop
FastDeploy/benchmarks/yaml
History
tianlef 8a964329f4 add glm benchmark yaml (#4289)
2025-09-26 14:23:29 +08:00
..
request_yaml
add glm benchmark yaml (#4289)
2025-09-26 14:23:29 +08:00
eb45-8k-fp8-tp1-dp8_ep.yaml
Create eb45-8k-fp8-tp1-dp8_ep.yaml (#3485)
2025-08-20 14:33:54 +08:00
eb45-21b-a3b-32k-bf16.yaml
Sync v2.0 version of code to github repo
2025-06-29 23:29:37 +00:00
eb45-21b-a3b-32k-wint4-a10.yaml
Sync v2.0 version of code to github repo
2025-06-29 23:29:37 +00:00
eb45-21b-a3b-32k-wint4.yaml
Sync v2.0 version of code to github repo
2025-06-29 23:29:37 +00:00
eb45-21b-a3b-32k-wint8.yaml
Sync v2.0 version of code to github repo
2025-06-29 23:29:37 +00:00
eb45-21B-vl-128k-wint4-h800-tp1.yaml
polish code with new pre-commit rule (#2923)
2025-07-19 23:19:27 +08:00
eb45-32k-bf16-a30-tp1.yaml
Sync v2.0 version of code to github repo
2025-06-29 23:29:37 +00:00
eb45-32k-blockwise-fp8-h800-tp8.yaml
Sync v2.0 version of code to github repo
2025-06-29 23:29:37 +00:00
eb45-32k-tensorwise-fp8-h800-tp8.yaml
Sync v2.0 version of code to github repo
2025-06-29 23:29:37 +00:00
eb45-32k-w4a8c8-a800-tp4.yaml
Sync v2.0 version of code to github repo
2025-06-29 23:29:37 +00:00
eb45-32k-w4a8c8-tp4_decode.yaml
polish code with new pre-commit rule (#2923)
2025-07-19 23:19:27 +08:00
eb45-32k-w4a8c8-tp4_prefill.yaml
polish code with new pre-commit rule (#2923)
2025-07-19 23:19:27 +08:00
eb45-32k-wint2-h20-tp1.yaml
Sync v2.0 version of code to github repo
2025-06-29 23:29:37 +00:00
eb45-32k-wint2-tp4.yaml
[benchmark]add lite-vl and x1 yaml (#4130)
2025-09-16 16:38:36 +08:00
eb45-32k-wint4-a800-tp4.yaml
[benchmark] add quantization for benchmark yaml (#2995)
2025-07-24 13:26:34 +08:00
eb45-32k-wint4-h800-dp8_decode.yaml
Sync v2.0 version of code to github repo
2025-06-29 23:29:37 +00:00
eb45-32k-wint4-h800-dp8_prefill.yaml
polish code with new pre-commit rule (#2923)
2025-07-19 23:19:27 +08:00
eb45-32k-wint4-mtp-h800-tp4.yaml
Sync v2.0 version of code to github repo
2025-06-29 23:29:37 +00:00
eb45-32k-wint4-mtp-tp4-decode.yaml
polish code with new pre-commit rule (#2923)
2025-07-19 23:19:27 +08:00
eb45-32k-wint4-mtp-tp4-prefill.yaml
polish code with new pre-commit rule (#2923)
2025-07-19 23:19:27 +08:00
eb45-32k-wint4-p800-tp4.yaml
Sync v2.0 version of code to github repo
2025-06-29 23:29:37 +00:00
eb45-32k-wint4-p800-tp8.yaml
Sync v2.0 version of code to github repo
2025-06-29 23:29:37 +00:00
eb45-32k-wint4-prefixcache-a800-tp4.yaml
Sync v2.0 version of code to github repo
2025-06-29 23:29:37 +00:00
eb45-32k-wint4-tp4_decode.yaml
[benchmark]add lite-vl and x1 yaml (#4130)
2025-09-16 16:38:36 +08:00
eb45-32k-wint4-tp4_prefill.yaml
[benchmark]add lite-vl and x1 yaml (#4130)
2025-09-16 16:38:36 +08:00
eb45-32k-wint8-a800-tp8.yaml
[benchmark] add quantization for benchmark yaml (#2995)
2025-07-24 13:26:34 +08:00
eb45-32k-wint8-p800-tp8.yaml
Sync v2.0 version of code to github repo
2025-06-29 23:29:37 +00:00
eb45-32k-wint8-prefixcache-a800-tp8.yaml
Sync v2.0 version of code to github repo
2025-06-29 23:29:37 +00:00
eb45-128k-wint4-a800-tp8.yaml
[benchmark]add lite-vl and x1 yaml (#4130)
2025-09-16 16:38:36 +08:00
eb45-128k-wint4-p800-tp8.yaml
Sync v2.0 version of code to github repo
2025-06-29 23:29:37 +00:00
eb45-128k-wint4-tp1-plas.yaml
[Doc]add plas attention config (#4128)
2025-09-16 15:55:12 +08:00
eb45-128k-wint8-a800-tp8.yaml
[benchmark]add lite-vl and x1 yaml (#4130)
2025-09-16 16:38:36 +08:00
eb45-vl-32k-wint4-a800-tp8.yaml
Sync v2.0 version of code to github repo
2025-06-29 23:29:37 +00:00
eb45-vl-32k-wint4-h800-tp8.yaml
Sync v2.0 version of code to github repo
2025-06-29 23:29:37 +00:00
eb45-vl-32k-wint4-tp4.yaml
Sync v2.0 version of code to github repo
2025-06-29 23:29:37 +00:00
eb45-vl-32k-wint8-a800-tp8.yaml
[benchmark]add lite-vl and x1 yaml (#4130)
2025-09-16 16:38:36 +08:00
eb45-vl-32k-wint8-h800-tp8.yaml
[benchmark]add lite-vl and x1 yaml (#4130)
2025-09-16 16:38:36 +08:00
eb45-vl-32k-wint8-tp4.yaml
Sync v2.0 version of code to github repo
2025-06-29 23:29:37 +00:00
eb45-vl-128k-wint4-h800-tp8.yaml
[benchmark]add lite-vl and x1 yaml (#4130)
2025-09-16 16:38:36 +08:00
eb45-vl-lite-32k-bf16-a800-tp1.yaml
[benchmark]add lite-vl and x1 yaml (#4130)
2025-09-16 16:38:36 +08:00
eb45-vl-lite-32k-wint4-a800-tp1.yaml
[benchmark]add lite-vl and x1 yaml (#4130)
2025-09-16 16:38:36 +08:00
eb45-vl-lite-32k-wint8-a800-tp1.yaml
[benchmark]add lite-vl and x1 yaml (#4130)
2025-09-16 16:38:36 +08:00
eb45t_0dot3b-32k-bf16-a30-tp1-static.yaml
[Executor] CUDA Graph support padding batch (#2844)
2025-07-15 19:49:01 -07:00
eb45t_0dot3b-32k-bf16-h800-tp1-static.yaml
[Executor] CUDA Graph support padding batch (#2844)
2025-07-15 19:49:01 -07:00
eb45t_0dot3b-32k-wint8-a30-tp1-static.yaml
[Executor] CUDA Graph support padding batch (#2844)
2025-07-15 19:49:01 -07:00
eb45t_0dot3b-32k-wint8-h800-tp1-static.yaml
[Executor] CUDA Graph support padding batch (#2844)
2025-07-15 19:49:01 -07:00
eb45t_21b-32k-bf16-h800-tp1-static.yaml
[Executor] CUDA Graph support padding batch (#2844)
2025-07-15 19:49:01 -07:00
eb45t_21b-32k-wint4-h800-tp1-static.yaml
[Executor] CUDA Graph support padding batch (#2844)
2025-07-15 19:49:01 -07:00
eb45t_300b-32k-wint4-h800-tp4-static.yaml
[Executor] CUDA Graph support padding batch (#2844)
2025-07-15 19:49:01 -07:00
GLM45-air-32k-bf16.yaml
add glm benchmark yaml (#4289)
2025-09-26 14:23:29 +08:00
GLM45-air-32k-wfp8afp8.yaml
add glm benchmark yaml (#4289)
2025-09-26 14:23:29 +08:00
qwen2_7b-32k-bf16-a30-tp1-static.yaml
[Executor] CUDA Graph support padding batch (#2844)
2025-07-15 19:49:01 -07:00
qwen2_7b-32k-bf16-h800-tp1-static.yaml
[Executor] CUDA Graph support padding batch (#2844)
2025-07-15 19:49:01 -07:00
qwen2_7b-32k-bf16-h800-tp1.yaml
Sync v2.0 version of code to github repo
2025-06-29 23:29:37 +00:00
qwen2_7b-32k-fp8-h800-tp1-static.yaml
[Executor] CUDA Graph support padding batch (#2844)
2025-07-15 19:49:01 -07:00
qwen2_7b-32k-fp8-h800-tp1.yaml
Sync v2.0 version of code to github repo
2025-06-29 23:29:37 +00:00
qwen2_7b-32k-wint8-h800-tp1.yaml
Sync v2.0 version of code to github repo
2025-06-29 23:29:37 +00:00
qwen3_0dot6b-32k-bf16-a30-tp1-static.yaml
[Executor] CUDA Graph support padding batch (#2844)
2025-07-15 19:49:01 -07:00
qwen3_0dot6b-32k-bf16-h800-tp1-static.yaml
[Executor] CUDA Graph support padding batch (#2844)
2025-07-15 19:49:01 -07:00
qwen3_0dot6b-32k-wint8-a30-tp1-static.yaml
[Executor] CUDA Graph support padding batch (#2844)
2025-07-15 19:49:01 -07:00
qwen3_0dot6b-32k-wint8-h800-tp1-static.yaml
[Executor] CUDA Graph support padding batch (#2844)
2025-07-15 19:49:01 -07:00
qwen3_30b-32k-bf16-h800-tp1-static.yaml
[Executor] CUDA Graph support padding batch (#2844)
2025-07-15 19:49:01 -07:00
qwen3_30b-32k-wint4-h800-tp1-static.yaml
[Executor] CUDA Graph support padding batch (#2844)
2025-07-15 19:49:01 -07:00
qwen3dot6b-32k-bf16-a30-tp1.yaml
Sync v2.0 version of code to github repo
2025-06-29 23:29:37 +00:00
qwen3dot6b-32k-bf16-a800-tp1.yaml
Sync v2.0 version of code to github repo
2025-06-29 23:29:37 +00:00
qwen3dot6b-32k-bf16-h800-tp1.yaml
Sync v2.0 version of code to github repo
2025-06-29 23:29:37 +00:00
qwen3dot6b-32k-wint8-a30-tp1.yaml
Sync v2.0 version of code to github repo
2025-06-29 23:29:37 +00:00
qwen3dot6b-32k-wint8-a800-tp1.yaml
Sync v2.0 version of code to github repo
2025-06-29 23:29:37 +00:00
qwen3dot6b-32k-wint8-h800-tp1.yaml
Sync v2.0 version of code to github repo
2025-06-29 23:29:37 +00:00
qwen3moe30b-32k-bf16-a800-tp1.yaml
Sync v2.0 version of code to github repo
2025-06-29 23:29:37 +00:00
qwen3moe30b-32k-bf16-h800-tp1.yaml
Sync v2.0 version of code to github repo
2025-06-29 23:29:37 +00:00
qwen3moe30b-32k-wint4-a800-tp1.yaml
Sync v2.0 version of code to github repo
2025-06-29 23:29:37 +00:00
qwen3moe30b-32k-wint4-h800-tp1.yaml
Sync v2.0 version of code to github repo
2025-06-29 23:29:37 +00:00
qwen3moe235b-32k-wint4-h800-tp4.yaml
polish code with new pre-commit rule (#2923)
2025-07-19 23:19:27 +08:00
qwen3moe235b-32k-wint8-h800-tp4.yaml
polish code with new pre-commit rule (#2923)
2025-07-19 23:19:27 +08:00
x1-32k-wint4-h800-tp8.yaml
Sync v2.0 version of code to github repo
2025-06-29 23:29:37 +00:00
x1-32k-wint4-p800-tp4.yaml
Sync v2.0 version of code to github repo
2025-06-29 23:29:37 +00:00
x1-32k-wint4-p800-tp8.yaml
Sync v2.0 version of code to github repo
2025-06-29 23:29:37 +00:00
x1-32k-wint4-prefixcache-h800-tp8.yaml
Sync v2.0 version of code to github repo
2025-06-29 23:29:37 +00:00
x1-32k-wint8-h800-tp8.yaml
Sync v2.0 version of code to github repo
2025-06-29 23:29:37 +00:00
x1-32k-wint8-p800-tp4.yaml
Sync v2.0 version of code to github repo
2025-06-29 23:29:37 +00:00
x1-32k-wint8-p800-tp8.yaml
polish code with new pre-commit rule (#2923)
2025-07-19 23:19:27 +08:00
x1-32k-wint8-prefixcache-h800-tp8.yaml
Sync v2.0 version of code to github repo
2025-06-29 23:29:37 +00:00
x1-64k-w4a8c8-tp4.yaml
[CE]add x1 w4a8c8 benchamrk config (#3607)
2025-08-26 11:27:32 +08:00
x1-a3b-128k-wint8-h800-tp1.yaml
x1_a3b config (#4135)
2025-09-16 19:44:46 +08:00