chen 823a47e64a [Feature] Support return logprob of generated tokens (#2784) ...

* online chat support logprobs

* check xpu

* check vl_gpu_model_runner

* only cuda support logprob

* get_worker() check platform

---------

Co-authored-by: Jiang-Jia-Jun <163579578+Jiang-Jia-Jun@users.noreply.github.com>

2025-07-10 15:47:42 +08:00

..

graph_optimization

Sync v2.0 version of code to github repo

2025-06-29 23:29:37 +00:00

guided_decoding

Sync v2.0 version of code to github repo

2025-06-29 23:29:37 +00:00

layers

[Feature] Support return logprob of generated tokens (#2784)

2025-07-10 15:47:42 +08:00

models

【Sync】Release/2.0.1 (#2745)

2025-07-08 14:38:18 +08:00

ops

【Sync】Release/2.0.1 (#2745)

2025-07-08 14:38:18 +08:00

__init__.py

[LLM] First commit the llm deployment code

2025-06-09 19:20:15 +08:00

load_weight_utils.py

[feat] support fa3 backend for pd disaggregated (#2695)

2025-07-03 22:33:27 +08:00

model_loader.py

【Sync】Release/2.0.1 (#2745)

2025-07-08 14:38:18 +08:00

pre_and_post_process.py

[Feature] Support return logprob of generated tokens (#2784)

2025-07-10 15:47:42 +08:00