[LLM] support send batch data and aggregate data (#2860)

* [LLM] support send batch data and aggregate data

* [LLM] fix ci bugs

* [LLM] fix ci bugs

* [LLM] fix ci bugs

* [LLM] fix ci bugs

* [LLM] update

fastdeploy/envs.py

@@ -101,6 +101,10 @@ environment_variables: dict[str, Callable[[], Any]] = {
     # Whether to use DeepGemm for FP8 blockwise MoE.
     "FD_USE_DEEP_GEMM":
     lambda: bool(int(os.getenv("FD_USE_DEEP_GEMM", "1"))),
+
+    # Whether to use aggregate send.
+    "FD_USE_AGGREGATE_SEND":
+    lambda: bool(int(os.getenv("FD_USE_AGGREGATE_SEND", "0"))),
 }