chen d33105baeb [Feature] Online Chat API Support Return logprobs (#2777) ...

* online chat support logprobs

* check xpu

* check vl_gpu_model_runner and xpu_model_runner

* get_worker() check platform

2025-07-10 16:33:40 +08:00

..

__init__.py

[LLM] First commit the llm deployment code

2025-06-09 19:20:15 +08:00

api_server.py

Check if the controller port is available (#2724)

2025-07-07 13:24:55 +08:00

protocol.py

[Feature] Online Chat API Support Return logprobs (#2777)

2025-07-10 16:33:40 +08:00

serving_chat.py

[Feature] Online Chat API Support Return logprobs (#2777)

2025-07-10 16:33:40 +08:00

serving_completion.py

[LLM] support multi node deploy (#2708)

2025-07-06 10:33:51 +08:00

test_openai.py

Sync v2.0 version of code to github repo

2025-06-29 23:29:37 +00:00