Zero Rains b23af29d0b Launch expert_service before kv_cache initialization in worker_process (#3045) ...

* launch expert_service before kv_cache initialization

* add two signal make sure model loading and expert_service lauching finished

* fix the EP bug

* fix ep

* update launching way

* fix ep

* update

* roback ep

* pre-commit all files

---------

Co-authored-by: RAM <gstian5555@outlook.com>
Co-authored-by: Divano <dddivano@outlook.com>

2025-08-11 19:38:46 +08:00

..

cache_manager

Update cache_messager.py (#3172)

2025-08-04 14:32:34 +08:00

demo

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

distributed

delete parallel_state.py (#3250)

2025-08-08 11:03:29 +08:00

engine

Launch expert_service before kv_cache initialization in worker_process (#3045)

2025-08-11 19:38:46 +08:00

entrypoints

[BugFix] fix too many open files problem (#3256)

2025-08-08 20:10:11 +08:00

input

enhance eos_tokens (#3274)

2025-08-11 14:47:52 +08:00

inter_communicator

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

metrics

[Trace]add trace when fd start (#3174)

2025-08-05 21:18:27 +08:00

model_executor

Revert "[BugFix] num_seqs (#3291)" (#3316)

2025-08-11 16:16:51 +08:00

multimodal

[Feature] remove dependency on enable_mm and refine multimodal's code (#3014)

2025-08-01 20:01:18 +08:00

output

Launch expert_service before kv_cache initialization in worker_process (#3045)

2025-08-11 19:38:46 +08:00

platforms

native top_p_sampling (#2901)

2025-07-22 14:09:59 +08:00

plugins

[plugin] Custom model_runner/model support (#3186)

2025-08-04 18:52:39 -07:00

reasoning

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

rl

qwen3_moe (#3084)

2025-08-06 14:45:27 +08:00

scheduler

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

spec_decode

[BugFix] support real batch_size (#3109)

2025-08-05 16:33:54 +08:00

splitwise

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

worker

Launch expert_service before kv_cache initialization in worker_process (#3045)

2025-08-11 19:38:46 +08:00

__init__.py

【Feature】add fd plugins && rm model_classes (#3123)

2025-08-03 19:53:20 -07:00

config.py

enhance eos_tokens (#3274)

2025-08-11 14:47:52 +08:00

envs.py

enhance eos_tokens (#3274)

2025-08-11 14:47:52 +08:00

import_ops.py

fix import error (#2944)

2025-07-22 14:06:01 +08:00

stop.sh

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

test.yaml

[Sync] Update to latest code (#2679)

2025-07-03 15:43:53 +08:00

utils.py

[BugFix] fix too many open files problem (#3256)

2025-08-08 20:10:11 +08:00