chenjian ffec66097c [optimize] Optimize prefix caching in v1 release/2.1 (#3823) ...

* [optimize] Optimize prefix caching in v1

* [optimize] Optimize prefix caching in v1

---------

Co-authored-by: Jiang-Jia-Jun <163579578+Jiang-Jia-Jun@users.noreply.github.com>

2025-09-04 19:25:02 +08:00

..

sched

[optimize] Optimize prefix caching in v1 release/2.1 (#3823)

2025-09-04 19:25:02 +08:00

__init__.py

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

args_utils.py

[CP] CP Lm head fp32 and temp_logprob to release/2.1 (#3766)

2025-09-01 19:56:54 +08:00

config.py

[Feature] add tool parser (#3518)

2025-08-22 11:14:35 +08:00

engine.py

[optimize] Optimize prefix caching in v1 release/2.1 (#3823)

2025-09-04 19:25:02 +08:00

expert_service.py

[BugFix] ep mixed mode offline exit failed (#3623)

2025-08-26 20:12:44 +08:00

kv_cache_interface.py

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

request.py

[Feature] add tool parser (#3518)

2025-08-22 11:14:35 +08:00

resource_manager.py

[feat] add metrics for yiyan adapter (#3615)

2025-08-28 21:16:58 +08:00

sampling_params.py

[CP] CP Lm head fp32 and temp_logprob to release/2.1 (#3766)

2025-09-01 19:56:54 +08:00