RAM 86d5006a57 [Graph Optimization][Speculative Decoding] Update yaml and fix typo (#4612)

2025-10-28 11:43:26 +08:00

..

request_yaml

benchmark工具适配SGLang框架 (#4607)

2025-10-27 18:52:56 +08:00

deepseek-32k-tp8-wint4.yaml

[Doc]fix deepseek ce (#4560)

2025-10-23 14:09:11 +08:00

eb45-8k-fp8-tp1-dp8_ep.yaml

…

eb45-21b-a3b-32k-bf16.yaml

…

eb45-21b-a3b-32k-wint4-a10.yaml

…

eb45-21b-a3b-32k-wint4.yaml

…

eb45-21b-a3b-32k-wint8.yaml

…

eb45-21B-vl-128k-wint4-h800-tp1.yaml

…

eb45-32k-bf16-a30-tp1.yaml

…

eb45-32k-blockwise-fp8-h800-tp8.yaml

…

eb45-32k-tensorwise-fp8-h800-tp8.yaml

…

eb45-32k-w4a8c8-a800-tp4.yaml

…

eb45-32k-w4a8c8-tp4_decode.yaml

…

eb45-32k-w4a8c8-tp4_prefill.yaml

…

eb45-32k-wint2-h20-tp1.yaml

…

eb45-32k-wint2-tp4.yaml

[benchmark]add lite-vl and x1 yaml (#4130)

2025-09-16 16:38:36 +08:00

eb45-32k-wint4-a800-tp4.yaml

[Executor] Default use CUDAGraph (#3594)

2025-10-21 14:25:45 +08:00

eb45-32k-wint4-h800-dp8_decode.yaml

…

eb45-32k-wint4-h800-dp8_prefill.yaml

…

eb45-32k-wint4-mtp-h800-tp4.yaml

[Graph Optimization][Speculative Decoding] Update yaml and fix typo (#4612)

2025-10-28 11:43:26 +08:00

eb45-32k-wint4-mtp-tp4-decode.yaml

…

eb45-32k-wint4-mtp-tp4-prefill.yaml

…

eb45-32k-wint4-p800-tp4.yaml

…

eb45-32k-wint4-p800-tp8.yaml

…

eb45-32k-wint4-prefixcache-a800-tp4.yaml

…

eb45-32k-wint4-tp4_decode.yaml

[benchmark]add lite-vl and x1 yaml (#4130)

2025-09-16 16:38:36 +08:00

eb45-32k-wint4-tp4_prefill.yaml

[benchmark]add lite-vl and x1 yaml (#4130)

2025-09-16 16:38:36 +08:00

eb45-32k-wint8-a800-tp8.yaml

[Executor] Default use CUDAGraph (#3594)

2025-10-21 14:25:45 +08:00

eb45-32k-wint8-p800-tp8.yaml

…

eb45-32k-wint8-prefixcache-a800-tp8.yaml

…

eb45-128k-wint4-a800-tp8.yaml

[benchmark]add lite-vl and x1 yaml (#4130)

2025-09-16 16:38:36 +08:00

eb45-128k-wint4-p800-tp8.yaml

…

eb45-128k-wint4-tp1-plas.yaml

[Doc]add plas attention config (#4128)

2025-09-16 15:55:12 +08:00

eb45-128k-wint8-a800-tp8.yaml

[benchmark]add lite-vl and x1 yaml (#4130)

2025-09-16 16:38:36 +08:00

eb45-vl-32k-wint4-a800-tp8.yaml

…

eb45-vl-32k-wint4-h800-tp8.yaml

…

eb45-vl-32k-wint4-tp4.yaml

…

eb45-vl-32k-wint8-a800-tp8.yaml

[benchmark]add lite-vl and x1 yaml (#4130)

2025-09-16 16:38:36 +08:00

eb45-vl-32k-wint8-h800-tp8.yaml

[benchmark]add lite-vl and x1 yaml (#4130)

2025-09-16 16:38:36 +08:00

eb45-vl-32k-wint8-tp4.yaml

…

eb45-vl-128k-wint4-h800-tp8.yaml

[benchmark]add lite-vl and x1 yaml (#4130)

2025-09-16 16:38:36 +08:00

eb45-vl-lite-32k-bf16-a800-tp1.yaml

[benchmark]add lite-vl and x1 yaml (#4130)

2025-09-16 16:38:36 +08:00

eb45-vl-lite-32k-wint4-a800-tp1.yaml

[benchmark]add lite-vl and x1 yaml (#4130)

2025-09-16 16:38:36 +08:00

eb45-vl-lite-32k-wint8-a800-tp1.yaml

[benchmark]add lite-vl and x1 yaml (#4130)

2025-09-16 16:38:36 +08:00

eb45t_0dot3b-32k-bf16-a30-tp1-static.yaml

…

eb45t_0dot3b-32k-bf16-h800-tp1-static.yaml

…

eb45t_0dot3b-32k-wint8-a30-tp1-static.yaml

…

eb45t_0dot3b-32k-wint8-h800-tp1-static.yaml

…

eb45t_21b-32k-bf16-h800-tp1-static.yaml

…

eb45t_21b-32k-wint4-h800-tp1-static.yaml

…

eb45t_300b-32k-wint4-h800-tp4-static.yaml

…

GLM45-air-32k-bf16.yaml

add glm benchmark yaml (#4289)

2025-09-26 14:23:29 +08:00

GLM45-air-32k-wfp8afp8.yaml

add glm benchmark yaml (#4289)

2025-09-26 14:23:29 +08:00

qwen2_7b-32k-bf16-a30-tp1-static.yaml

…

qwen2_7b-32k-bf16-h800-tp1-static.yaml

…

qwen2_7b-32k-bf16-h800-tp1.yaml

…

qwen2_7b-32k-fp8-h800-tp1-static.yaml

…

qwen2_7b-32k-fp8-h800-tp1.yaml

…

qwen2_7b-32k-wint8-h800-tp1.yaml

…

qwen3_0dot6b-32k-bf16-a30-tp1-static.yaml

…

qwen3_0dot6b-32k-bf16-h800-tp1-static.yaml

…

qwen3_0dot6b-32k-wint8-a30-tp1-static.yaml

…

qwen3_0dot6b-32k-wint8-h800-tp1-static.yaml

…

qwen3_30b-32k-bf16-h800-tp1-static.yaml

…

qwen3_30b-32k-wint4-h800-tp1-static.yaml

…

qwen3dot6b-32k-bf16-a30-tp1.yaml

…

qwen3dot6b-32k-bf16-a800-tp1.yaml

…

qwen3dot6b-32k-bf16-h800-tp1.yaml

…

qwen3dot6b-32k-wint8-a30-tp1.yaml

…

qwen3dot6b-32k-wint8-a800-tp1.yaml

…

qwen3dot6b-32k-wint8-h800-tp1.yaml

…

qwen3moe30b-32k-bf16-a800-tp1.yaml

…

qwen3moe30b-32k-bf16-h800-tp1.yaml

…

qwen3moe30b-32k-wint4-a800-tp1.yaml

…

qwen3moe30b-32k-wint4-h800-tp1.yaml

…

qwen3moe235b-32k-wint4-h800-tp4.yaml

…

qwen3moe235b-32k-wint8-h800-tp4.yaml

…

x1-32k-wint4-h800-tp8.yaml

…

x1-32k-wint4-p800-tp4.yaml

…

x1-32k-wint4-p800-tp8.yaml

…

x1-32k-wint4-prefixcache-h800-tp8.yaml

…

x1-32k-wint8-h800-tp8.yaml

…

x1-32k-wint8-p800-tp4.yaml

…

x1-32k-wint8-p800-tp8.yaml

…

x1-32k-wint8-prefixcache-h800-tp8.yaml

…

x1-64k-w4a8c8-tp4.yaml

[Executor] Default use CUDAGraph (#3594)

2025-10-21 14:25:45 +08:00

x1-a3b-128k-wint8-h800-tp1.yaml

add x1 a3b quantization (#4397)

2025-10-14 15:04:06 +08:00