zhenwenDang d48c03413f Feature/logprob bug fix (#2817) ...

* fix: handle missing logprobs at step 0 and incorrect finish reason with max_completion_tokens

* Prevent response_logprobs.logprob_token_ids[0] from going out of bounds

2025-07-12 16:48:51 +08:00

..

__init__.py

[LLM] First commit the llm deployment code

2025-06-09 19:20:15 +08:00

api_server.py

Global scheduler supports configuring hot updates (#2807)

2025-07-11 13:38:07 +08:00

protocol.py

Global scheduler supports configuring hot updates (#2807)

2025-07-11 13:38:07 +08:00

serving_chat.py

Feature/logprob bug fix (#2817)

2025-07-12 16:48:51 +08:00

serving_completion.py

[LLM] support multi node deploy (#2708)

2025-07-06 10:33:51 +08:00

test_openai.py

Sync v2.0 version of code to github repo

2025-06-29 23:29:37 +00:00