apps/FastDeploy
1
0
Fork 0
mirror of https://github.com/PaddlePaddle/FastDeploy.git synced 2025-10-18 22:44:39 +08:00
Code Issues Actions 6 Packages Projects Releases Wiki Activity

[BugFix] fix error of import paddle.base.core.Config (#3761)

Browse Source 
* 延迟 import Config

* support chunked_prefill

* support chunked_prefill
This commit is contained in:
Yuanle Liu
2025-09-02 17:23:27 +08:00
committed by GitHub
parent 905d89e42f
commit 306c024ff3
2 changed files with 20 additions and 3 deletions
Download Patch File Download Diff File Expand all files Collapse all files

3
fastdeploy/model_executor/layers/moe/ep.py
View File

@@ -18,7 +18,6 @@ from abc import abstractmethod
import paddle
from paddle import nn
from paddle.base.core import Config
from paddleformers.utils.log import logger
try:
@@ -103,6 +102,8 @@ class DeepEPEngine:
self.deepep_engine = None
from paddle.base.core import Config
self.ep_config = Config(24, 6, 256)
self.num_max_dispatch_tokens_per_rank = num_max_dispatch_tokens_per_rank