RAM 0fad10b35a [Executor] CUDA Graph support padding batch (#2844) ...

* cuda graph support padding batch

* Integrate the startup parameters for the graph optimization backend and provide support for user - defined capture sizes.

* Do not insert max_num_seqs when the user specifies a capture list

* Support set graph optimization config from YAML file

* update cuda graph ci

* fix ci bug

* fix ci bug

2025-07-15 19:49:01 -07:00

..

request_yaml

新增vLLM默认请求参数yaml

2025-07-15 19:31:27 +08:00

eb45-21b-a3b-32k-bf16.yaml

Sync v2.0 version of code to github repo

2025-06-29 23:29:37 +00:00

eb45-21b-a3b-32k-wint4-a10.yaml

Sync v2.0 version of code to github repo

2025-06-29 23:29:37 +00:00

eb45-21b-a3b-32k-wint4.yaml

Sync v2.0 version of code to github repo

2025-06-29 23:29:37 +00:00

eb45-21b-a3b-32k-wint8.yaml

Sync v2.0 version of code to github repo

2025-06-29 23:29:37 +00:00

eb45-21B-vl-128k-wint4-h800-tp1.yaml

Sync v2.0 version of code to github repo

2025-06-29 23:29:37 +00:00

eb45-32k-bf16-a30-tp1.yaml

Sync v2.0 version of code to github repo

2025-06-29 23:29:37 +00:00

eb45-32k-blockwise-fp8-h800-tp8.yaml

Sync v2.0 version of code to github repo

2025-06-29 23:29:37 +00:00

eb45-32k-tensorwise-fp8-h800-tp8.yaml

Sync v2.0 version of code to github repo

2025-06-29 23:29:37 +00:00

eb45-32k-w4a8c8-a800-tp4.yaml

Sync v2.0 version of code to github repo

2025-06-29 23:29:37 +00:00

eb45-32k-w4a8c8-tp4_decode.yaml

Sync v2.0 version of code to github repo

2025-06-29 23:29:37 +00:00

eb45-32k-w4a8c8-tp4_prefill.yaml

Sync v2.0 version of code to github repo

2025-06-29 23:29:37 +00:00

eb45-32k-wint2-h20-tp1.yaml

Sync v2.0 version of code to github repo

2025-06-29 23:29:37 +00:00

eb45-32k-wint4-a800-tp4.yaml

Sync v2.0 version of code to github repo

2025-06-29 23:29:37 +00:00

eb45-32k-wint4-h800-dp8_decode.yaml

Sync v2.0 version of code to github repo

2025-06-29 23:29:37 +00:00

eb45-32k-wint4-h800-dp8_prefill.yaml

Sync v2.0 version of code to github repo

2025-06-29 23:29:37 +00:00

eb45-32k-wint4-mtp-h800-tp4.yaml

Sync v2.0 version of code to github repo

2025-06-29 23:29:37 +00:00

eb45-32k-wint4-mtp-tp4-decode.yaml

Sync v2.0 version of code to github repo

2025-06-29 23:29:37 +00:00

eb45-32k-wint4-mtp-tp4-prefill.yaml

Sync v2.0 version of code to github repo

2025-06-29 23:29:37 +00:00

eb45-32k-wint4-p800-tp4.yaml

Sync v2.0 version of code to github repo

2025-06-29 23:29:37 +00:00

eb45-32k-wint4-p800-tp8.yaml

Sync v2.0 version of code to github repo

2025-06-29 23:29:37 +00:00

eb45-32k-wint4-prefixcache-a800-tp4.yaml

Sync v2.0 version of code to github repo

2025-06-29 23:29:37 +00:00

eb45-32k-wint4-tp4_decode.yaml

Sync v2.0 version of code to github repo

2025-06-29 23:29:37 +00:00

eb45-32k-wint4-tp4_prefill.yaml

Sync v2.0 version of code to github repo

2025-06-29 23:29:37 +00:00

eb45-32k-wint8-a800-tp8.yaml

Sync v2.0 version of code to github repo

2025-06-29 23:29:37 +00:00

eb45-32k-wint8-p800-tp8.yaml

Sync v2.0 version of code to github repo

2025-06-29 23:29:37 +00:00

eb45-32k-wint8-prefixcache-a800-tp8.yaml

Sync v2.0 version of code to github repo

2025-06-29 23:29:37 +00:00

eb45-128k-wint4-a800-tp8.yaml

Sync v2.0 version of code to github repo

2025-06-29 23:29:37 +00:00

eb45-128k-wint4-p800-tp8.yaml

Sync v2.0 version of code to github repo

2025-06-29 23:29:37 +00:00

eb45-128k-wint8-a800-tp8.yaml

Sync v2.0 version of code to github repo

2025-06-29 23:29:37 +00:00

eb45-vl-32k-wint4-a800-tp8.yaml

Sync v2.0 version of code to github repo

2025-06-29 23:29:37 +00:00

eb45-vl-32k-wint4-h800-tp8.yaml

Sync v2.0 version of code to github repo

2025-06-29 23:29:37 +00:00

eb45-vl-32k-wint4-tp4.yaml

Sync v2.0 version of code to github repo

2025-06-29 23:29:37 +00:00

eb45-vl-32k-wint8-a800-tp8.yaml

Sync v2.0 version of code to github repo

2025-06-29 23:29:37 +00:00

eb45-vl-32k-wint8-h800-tp8.yaml

Sync v2.0 version of code to github repo

2025-06-29 23:29:37 +00:00

eb45-vl-32k-wint8-tp4.yaml

Sync v2.0 version of code to github repo

2025-06-29 23:29:37 +00:00

eb45t_0dot3b-32k-bf16-a30-tp1-static.yaml

[Executor] CUDA Graph support padding batch (#2844)

2025-07-15 19:49:01 -07:00

eb45t_0dot3b-32k-bf16-h800-tp1-static.yaml

[Executor] CUDA Graph support padding batch (#2844)

2025-07-15 19:49:01 -07:00

eb45t_0dot3b-32k-wint8-a30-tp1-static.yaml

[Executor] CUDA Graph support padding batch (#2844)

2025-07-15 19:49:01 -07:00

eb45t_0dot3b-32k-wint8-h800-tp1-static.yaml

[Executor] CUDA Graph support padding batch (#2844)

2025-07-15 19:49:01 -07:00

eb45t_21b-32k-bf16-h800-tp1-static.yaml

[Executor] CUDA Graph support padding batch (#2844)

2025-07-15 19:49:01 -07:00

eb45t_21b-32k-wint4-h800-tp1-static.yaml

[Executor] CUDA Graph support padding batch (#2844)

2025-07-15 19:49:01 -07:00

eb45t_300b-32k-wint4-h800-tp4-static.yaml

[Executor] CUDA Graph support padding batch (#2844)

2025-07-15 19:49:01 -07:00

qwen2_7b-32k-bf16-a30-tp1-static.yaml

[Executor] CUDA Graph support padding batch (#2844)

2025-07-15 19:49:01 -07:00

qwen2_7b-32k-bf16-h800-tp1-static.yaml

[Executor] CUDA Graph support padding batch (#2844)

2025-07-15 19:49:01 -07:00

qwen2_7b-32k-bf16-h800-tp1.yaml

Sync v2.0 version of code to github repo

2025-06-29 23:29:37 +00:00

qwen2_7b-32k-fp8-h800-tp1-static.yaml

[Executor] CUDA Graph support padding batch (#2844)

2025-07-15 19:49:01 -07:00

qwen2_7b-32k-fp8-h800-tp1.yaml

Sync v2.0 version of code to github repo

2025-06-29 23:29:37 +00:00

qwen2_7b-32k-wint8-h800-tp1.yaml

Sync v2.0 version of code to github repo

2025-06-29 23:29:37 +00:00

qwen3_0dot6b-32k-bf16-a30-tp1-static.yaml

[Executor] CUDA Graph support padding batch (#2844)

2025-07-15 19:49:01 -07:00

qwen3_0dot6b-32k-bf16-h800-tp1-static.yaml

[Executor] CUDA Graph support padding batch (#2844)

2025-07-15 19:49:01 -07:00

qwen3_0dot6b-32k-wint8-a30-tp1-static.yaml

[Executor] CUDA Graph support padding batch (#2844)

2025-07-15 19:49:01 -07:00

qwen3_0dot6b-32k-wint8-h800-tp1-static.yaml

[Executor] CUDA Graph support padding batch (#2844)

2025-07-15 19:49:01 -07:00

qwen3_30b-32k-bf16-h800-tp1-static.yaml

[Executor] CUDA Graph support padding batch (#2844)

2025-07-15 19:49:01 -07:00

qwen3_30b-32k-wint4-h800-tp1-static.yaml

[Executor] CUDA Graph support padding batch (#2844)

2025-07-15 19:49:01 -07:00

qwen3dot6b-32k-bf16-a30-tp1.yaml

Sync v2.0 version of code to github repo

2025-06-29 23:29:37 +00:00

qwen3dot6b-32k-bf16-a800-tp1.yaml

Sync v2.0 version of code to github repo

2025-06-29 23:29:37 +00:00

qwen3dot6b-32k-bf16-h800-tp1.yaml

Sync v2.0 version of code to github repo

2025-06-29 23:29:37 +00:00

qwen3dot6b-32k-wint8-a30-tp1.yaml

Sync v2.0 version of code to github repo

2025-06-29 23:29:37 +00:00

qwen3dot6b-32k-wint8-a800-tp1.yaml

Sync v2.0 version of code to github repo

2025-06-29 23:29:37 +00:00

qwen3dot6b-32k-wint8-h800-tp1.yaml

Sync v2.0 version of code to github repo

2025-06-29 23:29:37 +00:00

qwen3moe30b-32k-bf16-a800-tp1.yaml

Sync v2.0 version of code to github repo

2025-06-29 23:29:37 +00:00

qwen3moe30b-32k-bf16-h800-tp1.yaml

Sync v2.0 version of code to github repo

2025-06-29 23:29:37 +00:00

qwen3moe30b-32k-wint4-a800-tp1.yaml

Sync v2.0 version of code to github repo

2025-06-29 23:29:37 +00:00

qwen3moe30b-32k-wint4-h800-tp1.yaml

Sync v2.0 version of code to github repo

2025-06-29 23:29:37 +00:00

qwen3moe235b-32k-wint4-h800-tp4.yaml

Sync v2.0 version of code to github repo

2025-06-29 23:29:37 +00:00

qwen3moe235b-32k-wint8-h800-tp4.yaml

Sync v2.0 version of code to github repo

2025-06-29 23:29:37 +00:00

x1-32k-wint4-h800-tp8.yaml

Sync v2.0 version of code to github repo

2025-06-29 23:29:37 +00:00

x1-32k-wint4-p800-tp4.yaml

Sync v2.0 version of code to github repo

2025-06-29 23:29:37 +00:00

x1-32k-wint4-p800-tp8.yaml

Sync v2.0 version of code to github repo

2025-06-29 23:29:37 +00:00

x1-32k-wint4-prefixcache-h800-tp8.yaml

Sync v2.0 version of code to github repo

2025-06-29 23:29:37 +00:00

x1-32k-wint8-h800-tp8.yaml

Sync v2.0 version of code to github repo

2025-06-29 23:29:37 +00:00

x1-32k-wint8-p800-tp4.yaml

Sync v2.0 version of code to github repo

2025-06-29 23:29:37 +00:00

x1-32k-wint8-p800-tp8.yaml

Sync v2.0 version of code to github repo

2025-06-29 23:29:37 +00:00

x1-32k-wint8-prefixcache-h800-tp8.yaml

Sync v2.0 version of code to github repo

2025-06-29 23:29:37 +00:00