[Feature] Support pd ep deployment with yiyan adapter (#4029)

* [Feature] Support mixed deployment with yiyan adapter in release2.2

* fix metrics

* add unit test

* add unit test

* add unit test

* Support pd ep deployment with yiyan adapter

* Support pd ep deployment with yiyan adapter

* refactor cache messager

* support scheduler v1 in PD

* suppport pd v1 + chunk prefill

* suppport pd v1 + chunk prefill

* add eplb

* support eplb

* support eplb

* support eplb

* support v1

* fix

* fix

* fix bug

* remove eplb support

* support prefix cache in P

* fix bug

* fix bug

* support one stop in V1

* fix bug

* fix ci

* fix ci

* fix

* fix

* fix

* fix

* fix

---------

Co-authored-by: YuBaoku <49938469+EmmonsCurse@users.noreply.github.com>

fastdeploy/config.py

@@ -1481,7 +1481,7 @@ class FDConfig:
             self.model_config.model_format = "torch"
 
         # TODO
-        self.max_prefill_batch = 3
+        self.max_prefill_batch = int(os.getenv("MAX_PREFILL_NUM", "3"))
         if current_platform.is_xpu():
             self.max_prefill_batch = 1
         if self.model_config is not None and self.model_config.enable_mm: