[Feature] [PD] add simple router and refine splitwise deployment (#4709)

* add simple router and refine splitwise deployment

* fix
This commit is contained in:
Juncai
2025-11-06 14:56:02 +08:00
committed by GitHub
parent 831266da7a
commit 08ca0f6aea
39 changed files with 2397 additions and 171 deletions

View File

@@ -5,4 +5,4 @@ metadata:
max_tokens: 32768
repetition_penalty: 1.05
frequency_penalty: 0
presence_penalty: 0
presence_penalty: 0