yyssys abde903813 Automatically configure workers based on max-num-seqs (#3846) ...

Automatically configure workers based on max-num-seqs

2025-09-03 21:12:42 +08:00

..

tool_parsers

[Feature] add tool parser (#3483)

2025-08-21 17:25:44 +08:00

__init__.py

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

api_server.py

Automatically configure workers based on max-num-seqs (#3846)

2025-09-03 21:12:42 +08:00

multi_api_server.py

[NewFeature]Support dp multi api server && Fix some bug in mixed ep && merge develop (#3598)

2025-08-26 19:59:02 +08:00

protocol.py

[Feature] Add AsyncTokenizerClient&ChatResponseProcessor with remote encode&decode support. (#3674)

2025-08-30 17:06:26 +08:00

response_processors.py

[Feature] Add AsyncTokenizerClient&ChatResponseProcessor with remote encode&decode support. (#3674)

2025-08-30 17:06:26 +08:00

serving_chat.py

add reasoning parser plugin (#3811)

2025-09-03 18:31:27 +08:00

serving_completion.py

add reasoning parser plugin (#3811)

2025-09-03 18:31:27 +08:00

serving_models.py

[Feature] Models api (#3073)

2025-08-21 17:02:56 +08:00

test_openai.py

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

utils.py

[BugFix] fix logger (#3666)

2025-08-28 17:08:00 +08:00