xiaoxiaohehe001 a42fc3f40b [Feature] Support 45tVL EP FP8 Infer. (#2909) ...

* support_mm_ep_fp8

* support_mm_ep

2025-07-18 17:57:15 +08:00

..

cache_manager

[LLM] support multi node deploy (#2708)

2025-07-06 10:33:51 +08:00

demo

[Sync] Update to latest code (#2679)

2025-07-03 15:43:53 +08:00

distributed

[Feature] support custom all-reduce (#2758)

2025-07-09 16:00:27 +08:00

engine

[LLM] delete fixed slots (#2893)

2025-07-17 19:19:54 +08:00

entrypoints

[Feature] Support include_stop_str_in_output in chat/completion (#2910)

2025-07-18 16:59:18 +08:00

input

[Feature] Support include_stop_str_in_output in chat/completion (#2910)

2025-07-18 16:59:18 +08:00

inter_communicator

[LLM] support send batch data and aggregate data (#2860)

2025-07-16 23:42:20 +08:00

metrics

[Trace]fix opentelemetry can not work in uvicorn (#2906)

2025-07-17 23:16:45 +08:00

model_executor

[Feature] Support 45tVL EP FP8 Infer. (#2909)

2025-07-18 17:57:15 +08:00

output

[Features] Add speculative metrics (#2857)

2025-07-17 11:08:55 +08:00

platforms

dcu adapter ernie45t (#2756)

2025-07-09 18:56:27 +08:00

reasoning

add support QWQ enable_thinking (#2706)

2025-07-04 20:55:23 +08:00

rl

support vl ori_vacab_size (#2900)

2025-07-18 16:26:14 +08:00

scheduler

fix spelling error (#2827)

2025-07-14 13:12:57 +08:00

spec_decode

[Inference, rename] remove padding_offsets from atten use batch_id_per_token (#2880)

2025-07-17 18:41:31 +08:00

splitwise

Sync v2.0 version of code to github repo

2025-06-29 23:29:37 +00:00

worker

support vl ori_vacab_size (#2900)

2025-07-18 16:26:14 +08:00

__init__.py

[feature]add fd whl version info (#2698)

2025-07-04 14:12:42 +08:00

config.py

support vl ori_vacab_size (#2900)

2025-07-18 16:26:14 +08:00

envs.py

[Trace]fix opentelemetry can not work in uvicorn (#2906)

2025-07-17 23:16:45 +08:00

import_ops.py

[SOT] Make custom_op dy&st unified (#2733)

2025-07-08 19:21:44 +08:00

stop.sh

Sync v2.0 version of code to github repo

2025-06-29 23:29:37 +00:00

test.yaml

[Sync] Update to latest code (#2679)

2025-07-03 15:43:53 +08:00

utils.py

[LLM] Update Multinode Deployment (#2830)

2025-07-16 23:42:54 +08:00