ltd0924 3cd9d3060a [Fearture] Support mm model close prefix cache (#4502) ...

* support mm prefix cache close

* add

* fix

* fix

* fix

---------

Co-authored-by: ltd0924 <luotingdan@baidu.com>

2025-10-21 09:56:47 +08:00

..

tool_parsers

…

__init__.py

…

api_server.py

[Fearture] Support mm model close prefix cache (#4502)

2025-10-21 09:56:47 +08:00

multi_api_server.py

…

protocol.py

…

response_processors.py

…

serving_chat.py

…

serving_completion.py

…

serving_models.py

…

test_openai.py

…

utils.py

…