GoldPancake 909059c60a [Feature] Support for request-level speculative decoding metrics monitoring. (#5518) ...

* support spec metrics monitor per request

* fix bug

* remove debug log

* fix ut bugs

2025-12-12 12:22:18 +08:00

..

cli

…

openai

[Feature] Support for request-level speculative decoding metrics monitoring. (#5518)

2025-12-12 12:22:18 +08:00

__init__.py

…

api_server.py

…

chat_utils.py

…

engine_client.py

[Optimization] support mm prefill batch (#5313)

2025-12-11 22:21:14 +08:00

llm.py

fix logprobs (#5335)

2025-12-04 10:38:51 +08:00