GoldPancake 67da16bd7c fix mtp reschedule (#5144)

2025-11-20 21:28:21 +08:00

..

cache_manager

[Feature] mm prefix cache (#4554)

2025-11-19 19:32:14 +08:00

demo

[Feature] Add AsyncTokenizerClient&ChatResponseProcessor with remote encode&decode support. (#3674)

2025-08-30 17:06:26 +08:00

distributed

Supports DP+TP+EP hybrid parallel deployment strategy (#3489)

2025-08-26 00:04:01 -07:00

engine

[Feature] mm prefix cache (#4554)

2025-11-19 19:32:14 +08:00

entrypoints

[fix] add more logger info: max_tokens (#5122)

2025-11-19 18:59:43 +08:00

eplb

[Fix] Fix eplb for ep mixed (#4894)

2025-11-10 14:46:26 +08:00

input

[BugFix] rollback max_tokens and min_tokens when continue to infer (#5051)

2025-11-15 16:40:35 +08:00

inter_communicator

[Feature] support async download features (#4910)

2025-11-18 18:37:59 +08:00

logger

add error log to file (#3431)

2025-08-20 09:52:34 +08:00

metrics

[Cherry-pick] fix requests & block metrics (#4500)

2025-10-21 10:43:33 +08:00

model_executor

[Fix] Fix eplb for ep mixed (#4894)

2025-11-10 14:46:26 +08:00

multimodal

add hasher and ImagePosition

2025-10-23 15:20:21 +08:00

output

fix mtp reschedule (#5144)

2025-11-20 21:28:21 +08:00

platforms

[Feature] block sparse attention (#3668)

2025-08-29 19:46:30 +08:00

plugins

Each module should have its own plugins_loaded (#4149)

2025-09-23 15:44:46 +08:00

reasoning

fix reasoning parsers plugin (#4104)

2025-09-15 22:30:16 +08:00

rl

[Feature] Support eplb for ep (#4786)

2025-11-07 15:42:29 +08:00

scheduler

[Scheduler] update v1 prefill batch (#4563)

2025-10-31 14:03:18 +08:00

spec_decode

[Optimization] Reduce memory allocate for cudaGraph (#4838)

2025-11-06 13:32:47 +08:00

splitwise

[Feature] support adapter (#4180)

2025-09-22 19:32:24 +08:00

worker

[Fix] Fix eplb for ep mixed (#4894)

2025-11-10 14:46:26 +08:00

__init__.py

…

config.py

[Feature] mm prefix cache (#4554)

2025-11-19 19:32:14 +08:00

envs.py

support ENCODE_FEATURE_ENDPOINT (#4905)

2025-11-12 20:01:36 +08:00

import_ops.py

…

stop.sh

…

test.yaml

…

utils.py

[Feature] support async download features (#4910)

2025-11-18 18:37:59 +08:00