Zero Rains f8d3255520 [Cherry-Pick] Launch expert_service before kv_cache initialization in worker_process (#3558) ...

* launch expert_service before kv_cache initialization

* update code

---------

Co-authored-by: Jiang-Jia-Jun <163579578+Jiang-Jia-Jun@users.noreply.github.com>

2025-08-23 13:08:34 +08:00

..

sched

[XPU] Fixed the issue of performance degradation caused by enabling ENABLE_V1_KVCACHE_SCHEDULER (#3393)

2025-08-14 17:41:40 +08:00

__init__.py

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

args_utils.py

[Feature] add tool parser (#3518)

2025-08-22 11:14:35 +08:00

config.py

[Feature] add tool parser (#3518)

2025-08-22 11:14:35 +08:00

engine.py

[Cherry-Pick] Launch expert_service before kv_cache initialization in worker_process (#3558)

2025-08-23 13:08:34 +08:00

expert_service.py

[Cherry-Pick] Launch expert_service before kv_cache initialization in worker_process (#3558)

2025-08-23 13:08:34 +08:00

kv_cache_interface.py

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

request.py

[Feature] add tool parser (#3518)

2025-08-22 11:14:35 +08:00

resource_manager.py

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

sampling_params.py

[FIX 2.1]fix bad_words when sending requests consecutively (#3199)

2025-08-06 15:47:27 +08:00