ltd0924 3f535b45a2 [Feature] support prefix cache in DP (#4359) ...

* [Feature] support prefix cache in DP

* fix

* Update common_engine.py

* Update common_engine.py

* Update common_engine.py

* Update common_engine.py

---------

Co-authored-by: ltd0924 <luotingdan@baidu.com>

2025-10-11 10:12:12 +08:00

..

sched

Support MLA_CACHE & Fix V1_Schedule Bug (#4318)

2025-10-09 12:11:25 +08:00

__init__.py

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

args_utils.py

[Feature] support prefix cache in DP (#4359)

2025-10-11 10:12:12 +08:00

common_engine.py

[Feature] support prefix cache in DP (#4359)

2025-10-11 10:12:12 +08:00

engine.py

[feat] support prefix cache clearing when /clear_load_weight is called (#4008)

2025-09-28 19:42:53 +08:00

expert_service.py

[Feature] support prefix cache in DP (#4359)

2025-10-11 10:12:12 +08:00

kv_cache_interface.py

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

pooling_params.py

[Feature] support pool (#3827)

2025-09-22 14:09:09 +08:00

request.py

[Feature] Support pd ep deployment with yiyan adapter (#4029)

2025-09-22 16:41:38 +08:00

resource_manager.py

[Feature] Support pd ep deployment with yiyan adapter (#4029)

2025-09-22 16:41:38 +08:00

sampling_params.py

fix reasoning_max_tokens (#4277)

2025-09-28 14:05:29 +08:00

tasks.py

[Feature] support pool (#3827)

2025-09-22 14:09:09 +08:00