apps/FastDeploy
1
0
Fork 0
mirror of https://github.com/PaddlePaddle/FastDeploy.git synced 2025-12-24 13:28:13 +08:00
Code Issues Actions 2 Packages Projects Releases Wiki Activity

[FDConfig] [PD Disaggregation] [Graph Optimization] Close Cudagraph for P node when PD Disaggregation (#4632)

Browse Source 
* Close cudagraph for P node when PD Disaggregation

* fix problem
This commit is contained in:
Jundong Liu
2025-10-31 16:44:25 +08:00
committed by GitHub
parent 316f784016
commit 88a94c821b
1 changed files with 2 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
fastdeploy/config.py
View File

@@ -1547,6 +1547,8 @@ class FDConfig:
self.cache_config.max_encoder_cache = 0
# Adjustment GraphOptConfig
if self.scheduler_config is not None and self.scheduler_config.splitwise_role == "prefill":
self.graph_opt_config.use_cudagraph = self.graph_opt_config.cudagraph_only_prefill
if self.load_config is not None and self.load_config.dynamic_load_weight is True:
self.graph_opt_config.graph_opt_level = 0
logger.info(