ltd0924 3f535b45a2 [Feature] support prefix cache in DP (#4359) ...

* [Feature] support prefix cache in DP

* fix

* Update common_engine.py

* Update common_engine.py

* Update common_engine.py

* Update common_engine.py

---------

Co-authored-by: ltd0924 <luotingdan@baidu.com>

2025-10-11 10:12:12 +08:00

..

__init__.py

[LLM] First commit the llm deployment code

2025-06-09 19:20:15 +08:00

dcu_model_runner.py

[FDConfig]Remove splitwise_role and engine_worker_queue_port in FDConfig (#4147)

2025-09-19 17:01:52 +08:00

dcu_worker.py

fix typos (#3840)

2025-09-12 11:04:38 +08:00

eplb.py

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

experts_manager.py

fix typos (#3684)

2025-09-01 17:50:17 +08:00

gcu_model_runner.py

[Feature] support clear data (#3601)

2025-09-23 10:20:02 +08:00

gcu_worker.py

fix typos (#3684)

2025-09-01 17:50:17 +08:00

gpu_model_runner.py

[Feature] support prefix cache in DP (#4359)

2025-10-11 10:12:12 +08:00

gpu_worker.py

fix paddle_peak_increase size (#4355)

2025-10-10 21:31:38 +08:00

hpu_model_runner.py

[Executor]CUDAGraph support Speculate Decode (#3769)

2025-10-09 21:18:29 +08:00

hpu_worker.py

[Intel HPU] Support intel hpu platform (#4161)

2025-09-24 12:27:50 +08:00

iluvatar_model_runner.py

[Iluvatar GPU] Optimze attention and moe performance (#3234)

2025-08-08 10:51:24 +08:00

iluvatar_worker.py

fix typos (#3684)

2025-09-01 17:50:17 +08:00

metax_model_runner.py

[FDConfig]Remove splitwise_role and engine_worker_queue_port in FDConfig (#4147)

2025-09-19 17:01:52 +08:00

metax_worker.py

fix typos (#3684)

2025-09-01 17:50:17 +08:00

model_runner_base.py

[FDConfig]Remove max_num_batched_tokens/max_num_seqs in parallel config (#4116)

2025-09-17 10:43:35 +08:00

output.py

[Feature] General support for logprobs (#2974)

2025-07-31 20:25:56 +08:00

utils.py

fix typos (#3684)

2025-09-01 17:50:17 +08:00

worker_base.py

[FDConfig]Remove splitwise_role and engine_worker_queue_port in FDConfig (#4147)

2025-09-19 17:01:52 +08:00

worker_process.py

revert worker process ipc signal suffix (#4323)

2025-09-30 03:56:41 -07:00

xpu_model_runner.py

[XPU] Support W4A8C8-TP4-300B Model (#4068)

2025-10-10 15:41:32 +08:00

xpu_worker.py

[XPU] support XPU VL model inference (#4030)

2025-09-25 14:34:15 +08:00