apps/FastDeploy
1
0
Fork 0
mirror of https://github.com/PaddlePaddle/FastDeploy.git synced 2025-12-24 13:28:13 +08:00
Code Issues Actions 2 Packages Projects Releases Wiki Activity

[BugFix] fix eb5 mm prefix cache bug (#5638)

Browse Source 
* fix eb5 mm prefix cache bug

* update code

---------

Co-authored-by: Jiaxin Sui <95567040+plusNew001@users.noreply.github.com>
This commit is contained in:
kevin
2025-12-19 14:57:37 +08:00
committed by GitHub
parent 6bd772b93f
commit 807e404369
1 changed files with 1 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
fastdeploy/engine/sched/resource_manager_v1.py
View File

@@ -329,7 +329,7 @@ class ResourceManagerV1(ResourceManager):
token_st += h * w // 4
inputs["mm_positions"] = new_mm_positions
inputs["mm_hashes"] = new_mm_hashes
else:
elif inputs.get("mm_positions", None) is None or inputs.get("mm_hashes", None) is None:
inputs["mm_positions"] = []
inputs["mm_hashes"] = []