apps/FastDeploy
1
0
Fork 0
mirror of https://github.com/PaddlePaddle/FastDeploy.git synced 2025-10-04 16:22:57 +08:00
Code Issues Actions 2 Packages Projects Releases Wiki Activity

[BugFix] fix error of import paddle.base.core.Config (#3761) (#3804)

Browse Source 
* 延迟 import Config

* support chunked_prefill

* support chunked_prefill
This commit is contained in:
Yuanle Liu
2025-09-03 10:14:03 +08:00
committed by GitHub
parent 5cda326ba2
commit 174510180a
2 changed files with 20 additions and 3 deletions
Download Patch File Download Diff File Expand all files Collapse all files

3
fastdeploy/model_executor/layers/moe/ep.py
View File

@@ -18,7 +18,6 @@ from abc import abstractmethod
import paddle
from paddle import nn
from paddle.base.core import Config
from paddleformers.utils.log import logger
try:
@@ -103,6 +102,8 @@ class DeepEPEngine:
self.deepep_engine = None
from paddle.base.core import Config
self.ep_config = Config(24, 6, 256)
self.num_max_dispatch_tokens_per_rank = num_max_dispatch_tokens_per_rank