GoldPancake 909059c60a [Feature] Support for request-level speculative decoding metrics monitoring. (#5518) ...

* support spec metrics monitor per request

* fix bug

* remove debug log

* fix ut bugs

2025-12-12 12:22:18 +08:00

..

sched

[Optimization] support mm prefill batch (#5313)

2025-12-11 22:21:14 +08:00

__init__.py

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

args_utils.py

[Optimization] support mm prefill batch (#5313)

2025-12-11 22:21:14 +08:00

async_llm.py

[Engine] [Feature] Refactor async_llm:cross-process with EngineService，based on zmq communication (#4868)

2025-12-09 10:53:40 +08:00

common_engine.py

[Optim] Improve task-checking performance in engine-worker-queue (#5376)

2025-12-11 10:33:32 +08:00

engine.py

fix attention bug in spec decoding (#5460)

2025-12-10 10:56:37 +08:00

expert_service.py

[PD Disaggregation] Unify the disaggregation info and the pd communication (#5438)

2025-12-09 14:44:59 +08:00

kv_cache_interface.py

bug: fix list to List (#4818)

2025-11-06 16:13:12 +08:00

pooling_params.py

[Feature] support reward model (#5301)

2025-12-02 14:55:31 +08:00

request.py

[Feature] Support for request-level speculative decoding metrics monitoring. (#5518)

2025-12-12 12:22:18 +08:00

resource_manager.py

[PD Disaggregation] Add timestamp for analyzing splitwise deployment (#5317)

2025-12-08 10:08:44 +08:00

sampling_params.py

[LogProbs]Enable prompt logprobs output and modify data transmission method for the online interface. (#5089)

2025-12-02 13:49:51 +08:00

tasks.py

[feature] support reward api (#4518)

2025-10-29 00:20:28 +08:00