chen 823a47e64a [Feature] Support return logprob of generated tokens (#2784) ...

* online chat support logprobs

* check xpu

* check vl_gpu_model_runner

* only cuda support logprob

* get_worker() check platform

---------

Co-authored-by: Jiang-Jia-Jun <163579578+Jiang-Jia-Jun@users.noreply.github.com>

2025-07-10 15:47:42 +08:00

..

cpu_ops

Sync v2.0 version of code to github repo

2025-06-29 23:29:37 +00:00

gpu_ops

[Feature] Support return logprob of generated tokens (#2784)

2025-07-10 15:47:42 +08:00

utils

Sync v2.0 version of code to github repo

2025-06-29 23:29:37 +00:00

xpu_ops

Sync v2.0 version of code to github repo

2025-06-29 23:29:37 +00:00

0001-DeepGEMM-95e81b3.patch

[feat] support fa3 backend for pd disaggregated (#2695)

2025-07-03 22:33:27 +08:00

MANIFEST.in

[LLM] First commit the llm deployment code

2025-06-09 19:20:15 +08:00

setup_ops_base.py

[Feature] Support return logprob of generated tokens (#2784)

2025-07-10 15:47:42 +08:00

setup_ops_cpu.py

Sync v2.0 version of code to github repo

2025-06-29 23:29:37 +00:00

setup_ops.py

[Feature 2.0.2] support top_k_top_p sampling (#2789)

2025-07-09 21:01:51 -07:00