[Feature] Support ep pd with external module (#3194)

* Support external module * Support external module * Support external module * Support external module * refactor code to make it more clear * refactor code to make it more clear * refactor code to make it more clear * refactor code to make it more clear * fix according to review * fix according to review * fix according to review * fix according to review * fix according to review * fix according to review * fix bug * fix bug * fix bug * merge --------- Co-authored-by: root <root@tjdm-inf-sci-k8s-hzz2-h12ni8-0202.tjdm.baidu.com>
2025-10-05 16:48:03 +08:00 · 2025-08-04 20:32:41 +08:00
parent 0443587a57
commit 9f9971844f
15 changed files with 876 additions and 218 deletions
--- a/fastdeploy/engine/args_utils.py
+++ b/fastdeploy/engine/args_utils.py
@@ -820,6 +820,7 @@ class EngineArgs:
            "max_num_partial_prefills",
            "max_long_partial_prefills",
            "long_prefill_token_threshold",
+            "splitwise_role"
        ]

        all = asdict(self)