[Optimize][Cherry-pick] Robust stabilty for PD deployment #5338 (#5395)

* [Optimize] Robust stabilty for PD deployment

---------

Co-authored-by: Kaipeng Deng <dengkaipeng@baidu.com>
This commit is contained in:
chenjian
2025-12-15 18:58:09 +08:00
committed by GitHub
parent f133ce501c
commit 4c76171b57
12 changed files with 161 additions and 41 deletions

View File

@@ -45,6 +45,7 @@ class MockConfig:
class SchedulerConfig:
name = "default"
splitwise_role = "mixed"
parallel_config = ParallelConfig()
speculative_config = SpeculativeConfig()

View File

@@ -40,6 +40,7 @@ class MockConfig:
class SchedulerConfig:
name = "default"
splitwise_role = "mixed"
parallel_config = ParallelConfig()
speculative_config = SpeculativeConfig()