Yuan Xiaolan c71ee0831c add w4afp8 offline script (#3636)

2025-08-29 17:56:05 +08:00

..

cache_manager

[NewFeature]Support dp multi api server && Fix some bug in mixed ep && merge develop (#3598)

2025-08-26 19:59:02 +08:00

demo

…

distributed

…

engine

add w4afp8 offline script (#3636)

2025-08-29 17:56:05 +08:00

entrypoints

[feat] completion api supports passing input token ids in either prompt or prompt_token_ids (#3311)

2025-08-29 14:19:42 +08:00

input

[feat] completion api supports passing input token ids in either prompt or prompt_token_ids (#3311)

2025-08-29 14:19:42 +08:00

inter_communicator

add input_processor plugin (#3657)

2025-08-28 22:53:57 +08:00

logger

…

metrics

…

model_executor

add w4afp8 offline script (#3636)

2025-08-29 17:56:05 +08:00

multimodal

fix MultimodalRegistry (#3699)

2025-08-29 11:01:30 +08:00

output

…

platforms

Revert "[Feature] block sparse attention (#3209)" (#3647)

2025-08-27 17:35:04 +08:00

plugins

add input_processor plugin (#3657)

2025-08-28 22:53:57 +08:00

reasoning

…

rl

add input_processor plugin (#3657)

2025-08-28 22:53:57 +08:00

scheduler

…

spec_decode

fix deepcopy(tp_group) in spec (#3648)

2025-08-29 16:08:21 +08:00

splitwise

[NewFeature]Support dp multi api server && Fix some bug in mixed ep && merge develop (#3598)

2025-08-26 19:59:02 +08:00

worker

add w4afp8 offline script (#3636)

2025-08-29 17:56:05 +08:00

__init__.py

…

config.py

[BugFix]fix dp&ep&tp and muti node infer (#3629)

2025-08-28 19:09:10 +08:00

envs.py

MoE Default use triton's blockwise fp8 in TP Case (#3678)

2025-08-29 11:07:30 +08:00

import_ops.py

…

stop.sh

…

test.yaml

…

utils.py

add input_processor plugin (#3657)

2025-08-28 22:53:57 +08:00