SunLei ee915220bd [Speculative Decoding] Add draft_logprobs Support for Speculative Decode MTP (#4467) ...

* feat: add draft_logprobs for Speculative Decode MTP

* feat: add draft_logprobs for Speculative Decode MTP

* feat: add draft_logprobs for Speculative Decode MTP

* fix: postprocess for speculative decode

* test: test_speculative_decoding_use_logprobs

* fix: test_completion_echo

* fix test_max_streaming_tokens

---------

Co-authored-by: Jiang-Jia-Jun <163579578+Jiang-Jia-Jun@users.noreply.github.com>

2025-10-21 14:57:50 +08:00

..

sched

[Bug fix] Fix pd for x1 thinking (#4433)

2025-10-16 12:03:45 +08:00

__init__.py

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

args_utils.py

[Executor] Default use CUDAGraph (#3594)

2025-10-21 14:25:45 +08:00

common_engine.py

[fix] remove cache tensor creation for cache_transfer_manager (#4420)

2025-10-20 16:19:56 +08:00

engine.py

Optimizing the performance of think length limit using custom operators (#4279)

2025-10-20 21:09:13 +08:00

expert_service.py

[FDConfig]Remove reasoning_parser/guided_decoding_backend/disable_any_whitespace/device_ids in FDConfig (#4362)

2025-10-17 10:40:59 +08:00

kv_cache_interface.py

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

pooling_params.py

[Feature] support pooling model dummy_run (#4345)

2025-10-17 13:30:55 +08:00

request.py

[Speculative Decoding] Add draft_logprobs Support for Speculative Decode MTP (#4467)

2025-10-21 14:57:50 +08:00

resource_manager.py

[fix] fix requests & block metrics (#4404)

2025-10-15 11:49:24 +08:00

sampling_params.py

fix reasoning_max_tokens (#4277)

2025-09-28 14:05:29 +08:00

tasks.py

[Feature] support pool (#3827)

2025-09-22 14:09:09 +08:00