ltd0924 d245d1ca6c [LLM] support send batch data and aggregate data (#2860) ...

* [LLM] support send batch data and aggregate data

* [LLM] fix ci bugs

* [LLM] fix ci bugs

* [LLM] fix ci bugs

* [LLM] fix ci bugs

* [LLM] update

2025-07-16 23:42:20 +08:00

..

cache_manager

[LLM] support multi node deploy (#2708)

2025-07-06 10:33:51 +08:00

demo

[Sync] Update to latest code (#2679)

2025-07-03 15:43:53 +08:00

distributed

[Feature] support custom all-reduce (#2758)

2025-07-09 16:00:27 +08:00

engine

[LLM] support send batch data and aggregate data (#2860)

2025-07-16 23:42:20 +08:00

entrypoints

[LLM] support send batch data and aggregate data (#2860)

2025-07-16 23:42:20 +08:00

input

[Doc] modify offline-inerence docs (#2800)

2025-07-10 19:41:12 +08:00

inter_communicator

[LLM] support send batch data and aggregate data (#2860)

2025-07-16 23:42:20 +08:00

metrics

[Trace] add opentelemetry (#2852)

2025-07-16 15:33:25 +08:00

model_executor

fix and refine vl (#2866)

2025-07-16 05:59:28 -07:00

output

[LLM] support send batch data and aggregate data (#2860)

2025-07-16 23:42:20 +08:00

platforms

dcu adapter ernie45t (#2756)

2025-07-09 18:56:27 +08:00

reasoning

add support QWQ enable_thinking (#2706)

2025-07-04 20:55:23 +08:00

rl

fix and refine vl (#2866)

2025-07-16 05:59:28 -07:00

scheduler

fix spelling error (#2827)

2025-07-14 13:12:57 +08:00

spec_decode

[BugFix] Fix Configs (#2849)

2025-07-15 19:50:36 -07:00

splitwise

Sync v2.0 version of code to github repo

2025-06-29 23:29:37 +00:00

worker

fix and refine vl (#2866)

2025-07-16 05:59:28 -07:00

__init__.py

[feature]add fd whl version info (#2698)

2025-07-04 14:12:42 +08:00

config.py

fix and refine vl (#2866)

2025-07-16 05:59:28 -07:00

envs.py

[LLM] support send batch data and aggregate data (#2860)

2025-07-16 23:42:20 +08:00

import_ops.py

[SOT] Make custom_op dy&st unified (#2733)

2025-07-08 19:21:44 +08:00

stop.sh

Sync v2.0 version of code to github repo

2025-06-29 23:29:37 +00:00

test.yaml

[Sync] Update to latest code (#2679)

2025-07-03 15:43:53 +08:00

utils.py

[Executor] CUDA Graph support padding batch (#2844)

2025-07-15 19:49:01 -07:00