[BugFix] fix workers=1 (#4364)

* [Feature] support prefix cache in DP

* fix

* Update common_engine.py

* Update common_engine.py

* Update common_engine.py

* Update common_engine.py

* [BugFix] fix workers more than 1

* fix

* Update api_server.py

* fix

* Update api_server.py

* fix

---------

Co-authored-by: ltd0924 <luotingdan@baidu.com>
This commit is contained in:
ltd0924
2025-10-15 17:06:25 +08:00
committed by GitHub
parent bcaa98ff9c
commit d8841b7b40
5 changed files with 47 additions and 18 deletions

View File

@@ -30,6 +30,7 @@ use-triton-in-paddle
crcmod
fastsafetensors==0.1.14
msgpack
gunicorn
modelscope
opentelemetry-api>=1.24.0
opentelemetry-sdk>=1.24.0