ltd0924 d17886de19 [Feature] support ep in mixed mode (#3001) ...

* [LLM] support ep

* Update worker_process.py

* Update expert_service.py

* Update worker_process.py

* format files

2025-07-30 20:43:39 +08:00

..

cache_manager

[*] fix the memory leak when modify qp to rts failed (#3051)

2025-07-30 19:49:07 +08:00

demo

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

distributed

update flake8 version to support pre-commit in python3.12 (#3000)

2025-07-24 01:43:31 -07:00

engine

[Feature] support ep in mixed mode (#3001)

2025-07-30 20:43:39 +08:00

entrypoints

[feat] extra parameters are all passed directly via http payload now, or in extra_body if using openai client (#3058)

2025-07-30 19:25:20 +08:00

input

[Feature] Multimodal Scheduler V1 (#3019)

2025-07-30 16:05:55 +08:00

inter_communicator

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

metrics

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

model_executor

qwen loader (#3057)

2025-07-30 19:09:38 +08:00

output

[BugFix] vl encoder tokens dtype problem (#3069)

2025-07-30 15:20:53 +08:00

platforms

native top_p_sampling (#2901)

2025-07-22 14:09:59 +08:00

reasoning

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

rl

qwen loader (#3057)

2025-07-30 19:09:38 +08:00

scheduler

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

spec_decode

qwen loader (#3057)

2025-07-30 19:09:38 +08:00

splitwise

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

worker

[Feature] support ep in mixed mode (#3001)

2025-07-30 20:43:39 +08:00

__init__.py

[Fix] Fix version function (#3076)

2025-07-30 16:05:24 +08:00

config.py

qwen loader (#3057)

2025-07-30 19:09:38 +08:00

envs.py

[Feature] multi source download (#3005)

2025-07-24 17:42:09 +08:00

import_ops.py

fix import error (#2944)

2025-07-22 14:06:01 +08:00

stop.sh

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

test.yaml

[Sync] Update to latest code (#2679)

2025-07-03 15:43:53 +08:00

utils.py

[Fix] Fix version function (#3076)

2025-07-30 16:05:24 +08:00