ltd0924 3cd9d3060a [Fearture] Support mm model close prefix cache (#4502) ...

* support mm prefix cache close

* add

* fix

* fix

* fix

---------

Co-authored-by: ltd0924 <luotingdan@baidu.com>

2025-10-21 09:56:47 +08:00

..

tool_parsers

[Feature] add tool parser (#3483)

2025-08-21 17:25:44 +08:00

__init__.py

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

api_server.py

[Fearture] Support mm model close prefix cache (#4502)

2025-10-21 09:56:47 +08:00

multi_api_server.py

Update multi_api_server.py (#4023)

2025-09-10 17:15:01 +08:00

protocol.py

[Feature] support mtp logprob (#4457)

2025-10-20 10:18:00 +08:00

response_processors.py

[Feature] Add AsyncTokenizerClient&ChatResponseProcessor with remote encode&decode support. (#3674)

2025-08-30 17:06:26 +08:00

serving_chat.py

[Feature] support mtp logprob (#4457)

2025-10-20 10:18:00 +08:00

serving_completion.py

[Feature] support mtp logprob (#4457)

2025-10-20 10:18:00 +08:00

serving_models.py

[Feature] Models api (#3073)

2025-08-21 17:02:56 +08:00

test_openai.py

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

utils.py

[BugFix] fix logger (#3666)

2025-08-28 17:08:00 +08:00