Global scheduler supports configuring hot updates (#2807)

* Check if the controller port is available

* Global scheduler supports configuring hot updates

* add interface: /controller/scheduler

* add interface: /controller/scheduler
This commit is contained in:
lddfym
2025-07-11 13:38:07 +08:00
committed by GitHub
parent abbbd0cddc
commit b5e4288704
6 changed files with 207 additions and 108 deletions

View File

@@ -542,3 +542,12 @@ class ChatCompletionRequest(BaseModel):
)
return data
class ControlSchedulerRequest(BaseModel):
"""
Control scheduler request to the engine.
"""
reset: Optional[bool] = False
load_shards_num: Optional[int] = None
reallocate_shard: Optional[bool] = False