apps/FastDeploy
1
0
Fork 0
mirror of https://github.com/PaddlePaddle/FastDeploy.git synced 2025-10-21 15:49:31 +08:00
Code Issues Actions 6 Packages Projects Releases Wiki Activity

[feature]2.2 custom_allreduce support cudagraph recapture (#4307)

Browse Source 
* custom_allreduce support cudagraph recapture

* delete code

* add shut_down/restart default group
This commit is contained in:
chen
2025-09-29 18:14:21 +08:00
committed by GitHub
parent 9cc2c99539
commit 63a03ee152
7 changed files with 31 additions and 3 deletions
Download Patch File Download Diff File Expand all files Collapse all files

1
fastdeploy/rl/dynamic_weight_manager.py
View File

@@ -66,6 +66,7 @@ class DynamicWeightManager:
paddle.device.cuda.empty_cache()
if not self.first_load:
paddle.distributed.restart_process_group()
paddle.distributed.restart_process_group(self.parallel_config.tp_group)
if self.parallel_config.enable_expert_parallel:
paddle.distributed.restart_process_group(self.parallel_config.ep_group)