apps/FastDeploy
1
0
Fork 0
mirror of https://github.com/PaddlePaddle/FastDeploy.git synced 2025-10-05 16:48:03 +08:00
Code Issues Actions 2 Packages Projects Releases Wiki Activity

[BugFix]fix dp&ep&tp and muti node infer (#3629)

Browse Source 
* rm log

* fix bug

* fix bug

* fix dp&ep&tp and muti node infer

* fix

---------

Co-authored-by: Yuanle Liu <yuanlehome@163.com>
This commit is contained in:
gaoziyuan
2025-08-28 19:09:10 +08:00
committed by GitHub
parent 17731a8acd
commit fc635acc47
7 changed files with 48 additions and 34 deletions
Download Patch File Download Diff File Expand all files Collapse all files

1
fastdeploy/model_executor/model_loader/default_loader.py
View File

@@ -54,6 +54,7 @@ class DefaultModelLoader(BaseModelLoader):
@measure_time
def load_weights(self, model, fd_config: FDConfig, architectures: str) -> None:
model_class = ModelRegistry.get_pretrain_cls(architectures)
state_dict = load_composite_checkpoint(
fd_config.model_config.model,
model_class,