apps/FastDeploy
1
0
Fork 0
mirror of https://github.com/PaddlePaddle/FastDeploy.git synced 2025-10-06 09:07:10 +08:00
Code Issues Actions 2 Packages Projects Releases Wiki Activity

[Cherry-pick] FIx bug for scheduler V1 (#3167)

Browse Source 
* [BUG FIX] Fix bug when preempted request rescheduled (#3080)

* Fix bug when preempted request rescheduled

* Fix bug when preempted request rescheduled

* Fix bug when preempted request rescheduled

* Fix bug for offline inference in scheduler v1 (#3117)
This commit is contained in:
chenjian
2025-08-04 17:08:12 +08:00
committed by GitHub
parent a592d17615
commit 5439fb6336
3 changed files with 89 additions and 7 deletions
Download Patch File Download Diff File Expand all files Collapse all files

1
fastdeploy/engine/request.py
View File

@@ -117,6 +117,7 @@ class Request:
self.status = RequestStatus.WAITING
self.task_type = RequestType.PREFILL
self.idx = None
self.need_prefill_tokens = self.prompt_token_ids_len
@classmethod
def from_dict(cls, d: dict):