chenjian 98b3647aad [Fix] fix prefix cache in release21 (#3922) ...

* fix prefix cache in release21

* fix

* Fix when prompt ids is numpy

2025-09-08 11:33:59 +08:00

..

sched

[Fix] fix prefix cache in release21 (#3922)

2025-09-08 11:33:59 +08:00

__init__.py

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

args_utils.py

[CP] CP Lm head fp32 and temp_logprob to release/2.1 (#3766)

2025-09-01 19:56:54 +08:00

config.py

[Feature] add tool parser (#3518)

2025-08-22 11:14:35 +08:00

engine.py

[optimize] Optimize prefix caching in v1 release/2.1 (#3823)

2025-09-04 19:25:02 +08:00

expert_service.py

[BugFix] ep mixed mode offline exit failed (#3623)

2025-08-26 20:12:44 +08:00

kv_cache_interface.py

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

request.py

[Feature] add tool parser (#3518)

2025-08-22 11:14:35 +08:00

resource_manager.py

[feat] add metrics for yiyan adapter (#3615)

2025-08-28 21:16:58 +08:00

sampling_params.py

[CP] CP Lm head fp32 and temp_logprob to release/2.1 (#3766)

2025-09-01 19:56:54 +08:00