zhenwenDang 87203ec87b After enabling "top_logprobs supports passing 0 and fix max_completion_tokens", an incorrect finish_reason was returned. (#2815) ...

* /v1/chat/completions endpoint now supports max_completion_tokens and fixes the return value of finish_reason

* top_logprobs supports passing 0

2025-07-11 16:53:12 +08:00

..

__init__.py

[LLM] First commit the llm deployment code

2025-06-09 19:20:15 +08:00

api_server.py

Global scheduler supports configuring hot updates (#2812)

2025-07-11 13:39:30 +08:00

protocol.py

Global scheduler supports configuring hot updates (#2812)

2025-07-11 13:39:30 +08:00

serving_chat.py

After enabling "top_logprobs supports passing 0 and fix max_completion_tokens", an incorrect finish_reason was returned. (#2815)

2025-07-11 16:53:12 +08:00

serving_completion.py

Sync v2.0 version of code to github repo

2025-06-29 23:29:37 +00:00

test_openai.py

Sync v2.0 version of code to github repo

2025-06-29 23:29:37 +00:00