ltd0924 d8841b7b40 [BugFix] fix workers=1 (#4364) ...

* [Feature] support prefix cache in DP

* fix

* Update common_engine.py

* Update common_engine.py

* Update common_engine.py

* Update common_engine.py

* [BugFix] fix workers more than 1

* fix

* Update api_server.py

* fix

* Update api_server.py

* fix

---------

Co-authored-by: ltd0924 <luotingdan@baidu.com>

2025-10-15 17:06:25 +08:00

..

cli

[FastDeploy Cli] Bench Command eval and throughput (#4239)

2025-10-10 16:17:44 +08:00

openai

[BugFix] fix workers=1 (#4364)

2025-10-15 17:06:25 +08:00

__init__.py

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

api_server.py

add error traceback info (#3419)

2025-08-19 19:32:04 +08:00

chat_utils.py

[Feature] add HTTP GET retry (#3838)

2025-09-08 10:11:14 +08:00

engine_client.py

[feat] support prefix cache clearing when /clear_load_weight is called (#4008)

2025-09-28 19:42:53 +08:00

llm.py

[FDConfig]Remove max_model_len in FDConfig (#4350)

2025-10-11 14:04:17 +08:00