4 Commits

Author	SHA1	Message	Date
chenjian	c6a133d573	[Bug fix] Fix block num in scheduler v1 for release2.0.4 (#3314) ... * fix bug for scheduler v0 * fix block num setting in scheduler v1 * fix block num setting in scheduler v1 * fix block num setting in scheduler v1 * fix block num setting in scheduler v1 * fix block num setting in scheduler v1	2025-08-11 23:55:45 +08:00
chenjian	a84a98b107	fix scheduler bug due to async running (#3293)	2025-08-10 13:54:59 +08:00
chenjian	5439fb6336	[Cherry-pick] FIx bug for scheduler V1 (#3167) ... * [BUG FIX] Fix bug when preempted request rescheduled (#3080) * Fix bug when preempted request rescheduled * Fix bug when preempted request rescheduled * Fix bug when preempted request rescheduled * Fix bug for offline inference in scheduler v1 (#3117)	2025-08-04 17:08:12 +08:00
chenjian	85a78d695d	[Feature] Support block scheduler v1 for FD (#2928) ... * Support FD block scheduler v1 * Support FD block scheduler v1 * Support FD block scheduler v1 * Fix according to copilot review * Fix according to review * Remove is_dummy * Fix bug when real_bsz=1 * Fix infer first token cost time --------- Co-authored-by: Jiang-Jia-Jun <163579578+Jiang-Jia-Jun@users.noreply.github.com>	2025-07-23 20:31:31 +08:00