RAM d850660872 [Executor] Refactor GetBlockShapeAndSplitKVBlock Kernel (#2989) ...

* reset decoder_block_shape_q buffer

* refactor GetBlockShapeAndSplitKVBlock Kernel and cudagraph padding batch

* update decode_max_tile_size

* fix pre-commit

* update block_multihead_attn_backend

* update flas attn backend

* update MLA Attention

* update XPU Attention

* update gcu,iluvatar model runner

* Update MTP

* fix MTP bug

2025-07-31 00:09:31 +08:00

..

__init__.py

[LLM] First commit the llm deployment code

2025-06-09 19:20:15 +08:00

dcu_worker.py

Unify server-side and model-side Config (Part1) (#3018)

2025-07-28 10:51:52 +08:00

eplb.py

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

experts_manager.py

[Feature] Support_eplb (#2997)

2025-07-24 20:22:45 +08:00

gcu_model_runner.py

[Executor] Refactor GetBlockShapeAndSplitKVBlock Kernel (#2989)

2025-07-31 00:09:31 +08:00

gcu_worker.py

[SOT] Extend SOT warmup support to new hardware (#3032)

2025-07-29 22:45:20 +08:00

gpu_model_runner.py

[Executor] Refactor GetBlockShapeAndSplitKVBlock Kernel (#2989)

2025-07-31 00:09:31 +08:00

gpu_worker.py

Unify server-side and model-side Config (Part1) (#3018)

2025-07-28 10:51:52 +08:00

iluvatar_model_runner.py

[Executor] Refactor GetBlockShapeAndSplitKVBlock Kernel (#2989)

2025-07-31 00:09:31 +08:00

iluvatar_worker.py

[SOT] Extend SOT warmup support to new hardware (#3032)

2025-07-29 22:45:20 +08:00

model_runner_base.py

Unify server-side and model-side Config (Part1) (#3018)

2025-07-28 10:51:52 +08:00

output.py

[stop sequence] support stop sequence (#3025)

2025-07-29 14:17:37 +08:00

utils.py

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

worker_base.py

Unify server-side and model-side Config (Part1) (#3018)

2025-07-28 10:51:52 +08:00

worker_process.py

[BugFix]Fix ep size (#3092)

2025-07-30 21:03:12 +08:00

xpu_model_runner.py

qwen loader (#3057)

2025-07-30 19:09:38 +08:00

xpu_worker.py

[SOT] Extend SOT warmup support to new hardware (#3032)

2025-07-29 22:45:20 +08:00