chenjian 3878a99b69 [Fearture] Support cache kv cache for output tokens (#4535) ...

* [Fearture] Support cache kv cache for output tokens

* fix bug

* fix ci bug

* improve coverage

* enable output caching by default

* fix ci

---------

Co-authored-by: Jiang-Jia-Jun <163579578+Jiang-Jia-Jun@users.noreply.github.com>

2025-12-04 20:53:08 +08:00

..

test_get_save_output_v1.py

[Fearture] Support cache kv cache for output tokens (#4535)

2025-12-04 20:53:08 +08:00

test_pooler.py

[Docs] Add License in Unittest (#4957)

2025-11-12 10:44:09 +08:00

test_process_batch_draft_tokens.py

[Speculative Decoding] split draft_tokens into standalone post-processing path (#5205)

2025-11-27 11:22:41 +08:00

test_process_batch_output_use_zmq.py

[LogProbs]Enable prompt logprobs output and modify data transmission method for the online interface. (#5089)

2025-12-02 13:49:51 +08:00

test_process_batch_output.py

[Fearture] Support cache kv cache for output tokens (#4535)

2025-12-04 20:53:08 +08:00

test_stream_transfer_data.py

[Docs] Add License in Unittest (#4957)

2025-11-12 10:44:09 +08:00

test_token_processor_trace_print.py

[Log] Add trace log and add loggingInstrumentor tool (#4692)

2025-11-17 11:08:57 +08:00