周周周 ddb10ac509 [Inference, rename] remove padding_offsets from atten use batch_id_per_token (#2880) ...

* remove padding_offsets from atten

2025-07-17 18:41:31 +08:00

..

cache_manager

[LLM] support multi node deploy (#2708)

2025-07-06 10:33:51 +08:00

demo

[Sync] Update to latest code (#2679)

2025-07-03 15:43:53 +08:00

distributed

[Feature] support custom all-reduce (#2758)

2025-07-09 16:00:27 +08:00

engine

[LLM] fix serval bugs (#2878)

2025-07-17 14:21:05 +08:00

entrypoints

Update test_openai.py

2025-07-17 16:07:31 +08:00

input

[Fix] remove misleading variables (#2841)

2025-07-17 16:49:14 +08:00

inter_communicator

[LLM] support send batch data and aggregate data (#2860)

2025-07-16 23:42:20 +08:00

metrics

[Features] Add speculative metrics (#2857)

2025-07-17 11:08:55 +08:00

model_executor

[Inference, rename] remove padding_offsets from atten use batch_id_per_token (#2880)

2025-07-17 18:41:31 +08:00

output

[Features] Add speculative metrics (#2857)

2025-07-17 11:08:55 +08:00

platforms

dcu adapter ernie45t (#2756)

2025-07-09 18:56:27 +08:00

reasoning

add support QWQ enable_thinking (#2706)

2025-07-04 20:55:23 +08:00

rl

Fix rollout_model init (#2881)

2025-07-16 22:36:21 -07:00

scheduler

fix spelling error (#2827)

2025-07-14 13:12:57 +08:00

spec_decode

[Inference, rename] remove padding_offsets from atten use batch_id_per_token (#2880)

2025-07-17 18:41:31 +08:00

splitwise

Sync v2.0 version of code to github repo

2025-06-29 23:29:37 +00:00

worker

[Inference, rename] remove padding_offsets from atten use batch_id_per_token (#2880)

2025-07-17 18:41:31 +08:00

__init__.py

[feature]add fd whl version info (#2698)

2025-07-04 14:12:42 +08:00

config.py

[Feature][MTP] Support cacheKV transfer in per_chunk mode (#2890)

2025-07-17 17:58:08 +08:00

envs.py

[LLM] support send batch data and aggregate data (#2860)

2025-07-16 23:42:20 +08:00

import_ops.py

[SOT] Make custom_op dy&st unified (#2733)

2025-07-08 19:21:44 +08:00

stop.sh

Sync v2.0 version of code to github repo

2025-06-29 23:29:37 +00:00

test.yaml

[Sync] Update to latest code (#2679)

2025-07-03 15:43:53 +08:00

utils.py

[LLM] Update Multinode Deployment (#2830)

2025-07-16 23:42:54 +08:00