SunLei dade19d7a4 [Feature] General support for logprobs (#2974) ...

* [Feature] support logprobs in chat/completions and completions endpoints

* Temporarily comment out text_offset due to incorrect logic

* Clean up temporary debug prints

* [Feature] support logprobs in offline mode via SamplingParams

* fix: serialize Logprob as dict before zmq send to fix msgpack error

* refactor: remove redundant methods to simplify codebase

* Fix missing fields in CompletionOutput.to_dict affecting msgpack serialization

* refactor: centralize param validation in engine_client to reduce duplication

* revert: rollback changes in offline_demo.py

* revert: rollback changes in offline_demo.py

* [bugfix] fix parameter validation for logprobs

* [bugfix] fix parameter validation for logprobs

* [bugfix] fix parameter validation for logprobs

* [bugfix] fix parameter validation for logprobs

---------

Co-authored-by: Jiang-Jia-Jun <163579578+Jiang-Jia-Jun@users.noreply.github.com>

2025-07-31 20:25:56 +08:00

..

sched

[Feature] block scheduler v1 support prefix caching (#3061)

2025-07-31 19:29:19 +08:00

__init__.py

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

args_utils.py

qwen loader (#3057)

2025-07-30 19:09:38 +08:00

config.py

[Feature] support ep in mixed mode (#3001)

2025-07-30 20:43:39 +08:00

engine.py

[Feature] General support for logprobs (#2974)

2025-07-31 20:25:56 +08:00

expert_service.py

[Feature] support ep in mixed mode (#3001)

2025-07-30 20:43:39 +08:00

kv_cache_interface.py

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

request.py

[Feature] General support for logprobs (#2974)

2025-07-31 20:25:56 +08:00

resource_manager.py

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

sampling_params.py

[Feature] support bad_words (#3055)

2025-07-30 09:31:29 +08:00