apps/FastDeploy
1
0
Fork 0
mirror of https://github.com/PaddlePaddle/FastDeploy.git synced 2025-12-24 13:28:13 +08:00
Code Issues Actions 2 Packages Projects Releases Wiki Activity

[BugFix] race condition [is_fetching] causing multiple fetch requests (#5238)

Browse Source 
* RouterArgs port str -> int

* fix race condition [is_fetching] causing multiple fetch requests

* bugfix: Delete duplicate input_ids tensor creation
This commit is contained in:
Daci
2025-11-28 13:41:36 +08:00
committed by GitHub
parent 35479b691f
commit 7dc06cac6e
3 changed files with 4 additions and 4 deletions
Download Patch File Download Diff File Expand all files Collapse all files

1
fastdeploy/engine/sched/resource_manager_v1.py
View File

@@ -414,7 +414,6 @@ class ResourceManagerV1(ResourceManager):
):
input_ids_lst = request.prompt_token_ids + request.output_token_ids
input_ids = paddle.to_tensor(input_ids_lst, dtype="int64")
input_ids = paddle.to_tensor(input_ids_lst, dtype="int64")
image_patch_id = inputs["image_patch_id"]
if request.multimodal_img_boundaries is None: