GoldPancake e56c4dd0a8 [Cherry-Pick] Support for request-level speculative decoding metrics monitoring.(#5518) (#5614) ...

* support spec metrics monitor per request

2025-12-17 20:53:04 +08:00

..

test_get_save_output_v1.py

[Fearture] Support cache kv cache for output tokens (#4535)

2025-12-04 20:53:08 +08:00

test_pooler.py

[Docs] Add License in Unittest (#4957)

2025-11-12 10:44:09 +08:00

test_process_batch_draft_tokens.py

[Speculative Decoding] split draft_tokens into standalone post-processing path (#5205)

2025-11-27 11:22:41 +08:00

test_process_batch_output_use_zmq.py

[LogProbs]Enable prompt logprobs output and modify data transmission method for the online interface. (#5089)

2025-12-02 13:49:51 +08:00

test_process_batch_output.py

[Cherry-Pick] Support for request-level speculative decoding metrics monitoring.(#5518) (#5614)

2025-12-17 20:53:04 +08:00

test_stream_transfer_data.py

[Docs] Add License in Unittest (#4957)

2025-11-12 10:44:09 +08:00

test_token_processor_trace_print.py

[Log] Add trace log and add loggingInstrumentor tool (#4692)

2025-11-17 11:08:57 +08:00