apps/FastDeploy
1
0
Fork 0
mirror of https://github.com/PaddlePaddle/FastDeploy.git synced 2025-10-05 16:48:03 +08:00
Code Issues Actions 2 Packages Projects Releases Wiki Activity

[Feature] remove dependency on enable_mm and refine multimodal's code (#3014)

Browse Source 
* remove dependency on enable_mm

* fix codestyle check error

* fix codestyle check error

* update docs

* resolve conflicts on model config

* fix unit test error

* fix code style check error

---------

Co-authored-by: shige <1021937542@qq.com>
Co-authored-by: Jiang-Jia-Jun <163579578+Jiang-Jia-Jun@users.noreply.github.com>
This commit is contained in:
ApplEOFDiscord
2025-08-01 20:01:18 +08:00
committed by GitHub
parent 243394044d
commit b71cbb466d
24 changed files with 118 additions and 29 deletions
Download Patch File Download Diff File Expand all files Collapse all files

3
fastdeploy/entrypoints/openai/api_server.py
View File

@@ -105,13 +105,14 @@ async def lifespan(app: FastAPI):
pid = os.getpid()
api_server_logger.info(f"{pid}")
engine_client = EngineClient(
args.model,
args.tokenizer,
args.max_model_len,
args.tensor_parallel_size,
pid,
args.limit_mm_per_prompt,
args.mm_processor_kwargs,
args.enable_mm,
# args.enable_mm,
args.reasoning_parser,
args.data_parallel_size,
args.enable_logprob,