Zero Rains f8d3255520 [Cherry-Pick] Launch expert_service before kv_cache initialization in worker_process (#3558) ...

* launch expert_service before kv_cache initialization

* update code

---------

Co-authored-by: Jiang-Jia-Jun <163579578+Jiang-Jia-Jun@users.noreply.github.com>

2025-08-23 13:08:34 +08:00

..

__init__.py

[LLM] First commit the llm deployment code

2025-06-09 19:20:15 +08:00

dcu_worker.py

Unify server-side and model-side Config (Part1) (#3018)

2025-07-28 10:51:52 +08:00

eplb.py

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

experts_manager.py

[Feature] Support_eplb (#2997)

2025-07-24 20:22:45 +08:00

gcu_model_runner.py

[FIX 2.1]fix bad_words when sending requests consecutively (#3199)

2025-08-06 15:47:27 +08:00

gcu_worker.py

[BugFix] support real batch_size (#3109) (#3217)

2025-08-06 14:30:33 +08:00

gpu_model_runner.py

[Feature] Support limit thinking len for text models (#3527)

2025-08-22 14:48:15 +08:00

gpu_worker.py

[BugFix] support real batch_size (#3109) (#3217)

2025-08-06 14:30:33 +08:00

iluvatar_model_runner.py

[FIX 2.1]fix bad_words when sending requests consecutively (#3199)

2025-08-06 15:47:27 +08:00

iluvatar_worker.py

[BugFix] support real batch_size (#3109) (#3217)

2025-08-06 14:30:33 +08:00

model_runner_base.py

Unify server-side and model-side Config (Part1) (#3018)

2025-07-28 10:51:52 +08:00

output.py

[Feature] General support for logprobs (#2974)

2025-07-31 20:25:56 +08:00

utils.py

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

worker_base.py

Unify server-side and model-side Config (Part1) (#3018)

2025-07-28 10:51:52 +08:00

worker_process.py

[Cherry-Pick] Launch expert_service before kv_cache initialization in worker_process (#3558)

2025-08-23 13:08:34 +08:00

xpu_model_runner.py

[XPU] Fixed the issue of performance degradation caused by enabling ENABLE_V1_KVCACHE_SCHEDULER (#3393)

2025-08-14 17:41:40 +08:00

xpu_worker.py

revert pr (#3286)

2025-08-09 16:29:35 +08:00