apps/FastDeploy
1
0
Fork 0
mirror of https://github.com/PaddlePaddle/FastDeploy.git synced 2025-12-24 13:28:13 +08:00
Code Issues Actions 2 Packages Projects Releases Wiki Activity

[Optimization]1.fix tp+ep moe_forward; 2.set max_prefill_batch=env.MAX_PREFILL_NUM (#5353)

Browse Source 
* [Optimization] 1.fix tp+ep moe_forward; 2.set max_prefill_batch=env.MAX_PREFILL_NUM

* fix test_chunked_moe

---------

Co-authored-by: YuBaoku <49938469+EmmonsCurse@users.noreply.github.com>
This commit is contained in:
lzy
2025-12-03 16:42:10 +08:00
committed by GitHub
parent 04d35ace5e
commit f458cc5ba4
1 changed files with 1 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

1
tests/distributed/chunked_moe.py
View File

@@ -138,6 +138,7 @@ class TestChunkedMoE(unittest.TestCase):
fused_moe = FusedMoE.__new__(FusedMoE)
fused_moe.ep_size = 2
fused_moe.tp_size = 1
fused_moe.attn_tp_size = 1
fused_moe.reduce_results = True
fused_moe.fd_config = mock_fd_config