K11OntheBoat 8d99bac532 Remove CUDA ERROR 9 of inputs of get_padding_offset kernel (#5440) ...

Co-authored-by: K11OntheBoat <“ruianmaidanglao@163.com”>

2025-12-09 14:17:30 +08:00

..

benchmarks

…

cache_manager

[Feature] Multimodal Model P / D Separation (#5323)

2025-12-09 10:47:42 +08:00

demo

[PD Disaggregation] Add timestamp for analyzing splitwise deployment (#5317)

2025-12-08 10:08:44 +08:00

distributed

[BugFix] 0 not into cuda graph to save memory (#5426)

2025-12-08 16:47:44 +08:00

engine

[Optimization] compulte real max_logprobs in batch (#5430)

2025-12-09 14:15:05 +08:00

entrypoints

[PD Disaggregation] Add timestamp for analyzing splitwise deployment (#5317)

2025-12-08 10:08:44 +08:00

eplb

…

input

[Engine] [Feature] Refactor async_llm:cross-process with EngineService，based on zmq communication (#4868)

2025-12-09 10:53:40 +08:00

inter_communicator

[Engine] [Feature] Refactor async_llm:cross-process with EngineService，based on zmq communication (#4868)

2025-12-09 10:53:40 +08:00

logger

…

metrics

…

model_executor

Remove CUDA ERROR 9 of inputs of get_padding_offset kernel (#5440)

2025-12-09 14:17:30 +08:00

multimodal

…

output

[PD Disaggregation] Add timestamp for analyzing splitwise deployment (#5317)

2025-12-08 10:08:44 +08:00

platforms

…

plugins

[BugFix]Fix plugin loading logic and logging messages (#4909)

2025-12-05 19:25:01 +08:00

reasoning

…

rl

[New][RL] Support Rollout Routing Replay (#5405)

2025-12-05 22:06:26 +08:00

router

[PD Disaggregation] support DP via v1 router and decouple DP and EP (#5197)

2025-12-04 15:38:43 +08:00

scheduler

[Feature] Multimodal Model P / D Separation (#5323)

2025-12-09 10:47:42 +08:00

spec_decode

fix mtp prefix_cache dy-c8 bug (#5390)

2025-12-05 19:03:19 +08:00

splitwise

[Feature] Multimodal Model P / D Separation (#5323)

2025-12-09 10:47:42 +08:00

trace

…

transformer_utils

…

worker

[Optimization] compulte real max_logprobs in batch (#5430)

2025-12-09 14:15:05 +08:00

__init__.py

remove fastsafetensors (#5371)

2025-12-04 19:22:04 +08:00

collect_env.py

…

config.py

[BugFix] fix mm cudagraph (#5266)

2025-12-09 11:51:00 +08:00

envs.py

[Feature] [Benchmark]: add ZMQ-based FMQ implementation and benchmark tools (#5418)

2025-12-08 22:04:49 +08:00

import_ops.py

…

stop.sh

…

test.yaml

…

utils.py

[Feature] [Benchmark]: add ZMQ-based FMQ implementation and benchmark tools (#5418)

2025-12-08 22:04:49 +08:00