FastDeploy

mirror of https://github.com/PaddlePaddle/FastDeploy.git synced 2025-10-06 00:57:33 +08:00

Files

Zero Rains b23af29d0b Launch expert_service before kv_cache initialization in worker_process (#3045 )

* launch expert_service before kv_cache initialization

* add two signal make sure model loading and expert_service lauching finished

* fix the EP bug

* fix ep

* update launching way

* fix ep

* update

* roback ep

* pre-commit all files

---------

Co-authored-by: RAM <gstian5555@outlook.com>
Co-authored-by: Divano <dddivano@outlook.com>

2025-08-11 19:38:46 +08:00

sched

Launch expert_service before kv_cache initialization in worker_process (#3045 )

2025-08-11 19:38:46 +08:00

__init__.py

polish code with new pre-commit rule (#2923 )

2025-07-19 23:19:27 +08:00

args_utils.py

merge logprob into batch_output (#3266 )

2025-08-11 10:03:00 +08:00

config.py

[Feature] remove dependency on enable_mm and refine multimodal's code (#3014 )