freeliuzc c63361fd1d [Speculative Decoding][MTP]Support mtp in epdptp mode (#4614) ...

* support mtp many features

* support mtp reshard in rl mode

* fix function

* support mtp ep

* support mtp in hybird-dp-tp mode

* default open scheduler_v1 in mtp

2025-10-28 16:02:47 +08:00

..

__init__.py

[LLM] First commit the llm deployment code

2025-06-09 19:20:15 +08:00

dcu_model_runner.py

[FDConfig]Remove splitwise_role and engine_worker_queue_port in FDConfig (#4147)

2025-09-19 17:01:52 +08:00

dcu_worker.py

[FDConfig]Remove total_block_num/dtype/block_size/enc_dec_block_num in ParallelConfig (#4400)

2025-10-16 20:00:37 +08:00

eplb.py

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

experts_manager.py

fix typos (#3684)

2025-09-01 17:50:17 +08:00

gcu_model_runner.py

Optimizing the performance of think length limit using custom operators (#4279)

2025-10-20 21:09:13 +08:00

gcu_worker.py

[FDConfig]Remove total_block_num/dtype/block_size/enc_dec_block_num in ParallelConfig (#4400)

2025-10-16 20:00:37 +08:00

gpu_model_runner.py

1.fix the bug of draft model with ep 2.fix sampler bug (#4589)

2025-10-27 17:47:34 +08:00

gpu_worker.py

[FDConfig]Remove total_block_num/dtype/block_size/enc_dec_block_num in ParallelConfig (#4400)

2025-10-16 20:00:37 +08:00

hpu_model_runner.py

Optimizing the performance of think length limit using custom operators (#4279)

2025-10-20 21:09:13 +08:00

hpu_worker.py

[FDConfig]Remove total_block_num/dtype/block_size/enc_dec_block_num in ParallelConfig (#4400)

2025-10-16 20:00:37 +08:00

iluvatar_model_runner.py

[Iluvatar GPU] fix ci error caused by rebuild_padding param and cuda graph (#4504)

2025-10-21 21:41:41 +08:00

iluvatar_worker.py

[Iluvatar GPU] Adapt VL model (#4313)

2025-10-17 16:13:38 +08:00

metax_model_runner.py

[Metax] adapt DeepSeek (#4498)

2025-10-24 10:14:53 +08:00

metax_worker.py

[Metax] adapt DeepSeek (#4498)

2025-10-24 10:14:53 +08:00

model_runner_base.py

[FDConfig]Remove max_num_batched_tokens/max_num_seqs in parallel config (#4116)

2025-09-17 10:43:35 +08:00

output.py

Optimizing the performance of think length limit using custom operators (#4279)

2025-10-20 21:09:13 +08:00

worker_base.py

[FDConfig]Remove splitwise_role and engine_worker_queue_port in FDConfig (#4147)

2025-09-19 17:01:52 +08:00

worker_process.py

[Speculative Decoding][MTP]Support mtp in epdptp mode (#4614)

2025-10-28 16:02:47 +08:00

xpu_model_runner.py

[Feature] Support Paddle-OCR (#4396)

2025-10-24 23:34:30 +08:00

xpu_worker.py

[XPU]Modify the xpu memory display unit of log (#4534)

2025-10-22 12:46:01 +08:00