李泳桦 88297240e7 [feat] completion api supports passing input token ids in either prompt or prompt_token_ids (#3311) ...

* [feat] completion api supports passing input token ids in either `prompt` or `prompt_token_ids`

* [fix] update comment

* [fix] fix type error

* [test] add a unittest file for serving api test

* [test] try to fix ci error

* [chore] rename test function names

* [test] try to fix ci error

* [test] try to fix ci error

* [test] add tests for qwen

2025-08-29 14:19:42 +08:00

..

tool_parsers

[Feature] add tool parser (#3483)

2025-08-21 17:25:44 +08:00

__init__.py

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

api_server.py

add input_processor plugin (#3657)

2025-08-28 22:53:57 +08:00

multi_api_server.py

[NewFeature]Support dp multi api server && Fix some bug in mixed ep && merge develop (#3598)

2025-08-26 19:59:02 +08:00

protocol.py

[feat] completion api supports passing input token ids in either prompt or prompt_token_ids (#3311)

2025-08-29 14:19:42 +08:00

serving_chat.py

[NewFeature]Support dp multi api server && Fix some bug in mixed ep && merge develop (#3598)

2025-08-26 19:59:02 +08:00

serving_completion.py

[feat] completion api supports passing input token ids in either prompt or prompt_token_ids (#3311)

2025-08-29 14:19:42 +08:00

serving_models.py

[Feature] Models api (#3073)

2025-08-21 17:02:56 +08:00

test_openai.py

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

utils.py

[BugFix] fix logger (#3666)

2025-08-28 17:08:00 +08:00