chenjian 3878a99b69 [Fearture] Support cache kv cache for output tokens (#4535) ...

* [Fearture] Support cache kv cache for output tokens

* fix bug

* fix ci bug

* improve coverage

* enable output caching by default

* fix ci

---------

Co-authored-by: Jiang-Jia-Jun <163579578+Jiang-Jia-Jun@users.noreply.github.com>

2025-12-04 20:53:08 +08:00

..

sched

[Fearture] Support cache kv cache for output tokens (#4535)

2025-12-04 20:53:08 +08:00

__init__.py

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

args_utils.py

[Fearture] Support cache kv cache for output tokens (#4535)

2025-12-04 20:53:08 +08:00

async_llm.py

remove fastsafetensors (#5371)

2025-12-04 19:22:04 +08:00

common_engine.py

[PD Disaggregation] support DP via v1 router and decouple DP and EP (#5197)

2025-12-04 15:38:43 +08:00

engine.py

remove fastsafetensors (#5371)

2025-12-04 19:22:04 +08:00

expert_service.py

[PD Disaggregation] support DP via v1 router and decouple DP and EP (#5197)

2025-12-04 15:38:43 +08:00

kv_cache_interface.py

bug: fix list to List (#4818)

2025-11-06 16:13:12 +08:00

pooling_params.py

[Feature] support reward model (#5301)

2025-12-02 14:55:31 +08:00

request.py

[Feature] support audio tts (#5333)

2025-12-03 21:06:48 +08:00

resource_manager.py

[fix] fix requests & block metrics (#4404)

2025-10-15 11:49:24 +08:00

sampling_params.py

[LogProbs]Enable prompt logprobs output and modify data transmission method for the online interface. (#5089)

2025-12-02 13:49:51 +08:00

tasks.py

[feature] support reward api (#4518)

2025-10-29 00:20:28 +08:00