apps/FastDeploy
1
0
Fork 0
mirror of https://github.com/PaddlePaddle/FastDeploy.git synced 2025-10-05 08:37:06 +08:00
Code Issues Actions 2 Packages Projects Releases Wiki Activity

deepgemm don't support tp+ep (for ci) (#3638)

Browse Source 
* deepgemm don't support tp+ep (for ci)

* deepgemm don't support tp+ep (for ci)
This commit is contained in:
lzy
2025-08-27 16:39:19 +08:00
committed by GitHub
parent f0140be1e1
commit 1265f6c192
2 changed files with 1 additions and 2 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
fastdeploy/model_executor/layers/moe/fused_moe_deepgemm_backend.py
View File

@@ -571,6 +571,6 @@ class DeepGemmFusedMoeMethod(MoEMethodBase):
1.0,
)[0]
if layer.tp_size > 1:
tensor_model_parallel_all_reduce(tmp_ffn_out, self.tp_group)
tensor_model_parallel_all_reduce(tmp_ffn_out)
return tmp_ffn_out