ApplEOFDiscord 9566ae8827 [Bug Fix] disable prefix caching in mm model (#4167) ...

* add http get retry

* fix coments

* disable prefix caching in mm model

* fix unit test

---------

Co-authored-by: zhangjunjun04 <zhangjunjun04@baidu.com>
Co-authored-by: Jiang-Jia-Jun <163579578+Jiang-Jia-Jun@users.noreply.github.com>
Co-authored-by: YuBaoku <49938469+EmmonsCurse@users.noreply.github.com>

2025-09-24 14:43:46 +08:00

..

sched

[Feature] support clear data (#3601)

2025-09-23 10:20:02 +08:00

__init__.py

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

args_utils.py

[Bug Fix] disable prefix caching in mm model (#4167)

2025-09-24 14:43:46 +08:00

common_engine.py

[Feature] support clear data (#3601)

2025-09-23 10:20:02 +08:00

engine.py

【FIX】Change the name of sparse attn from moba to plas (#4006) (#4076)

2025-09-23 10:26:40 +08:00

expert_service.py

[Feature] Support pd ep deployment with yiyan adapter (#4029)

2025-09-22 16:41:38 +08:00

kv_cache_interface.py

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

pooling_params.py

[Feature] support pool (#3827)

2025-09-22 14:09:09 +08:00

request.py

[Feature] Support pd ep deployment with yiyan adapter (#4029)

2025-09-22 16:41:38 +08:00

resource_manager.py

[Feature] Support pd ep deployment with yiyan adapter (#4029)

2025-09-22 16:41:38 +08:00

sampling_params.py

[Feature] support pool (#3827)

2025-09-22 14:09:09 +08:00

tasks.py

[Feature] support pool (#3827)

2025-09-22 14:09:09 +08:00