李泳桦 6265f4385f [feat] support prefix cache clearing when /clear_load_weight is called (#4008) ...

* [feat] support clearing prefix cache (cherry-picked from release/2.1)

* [fix] fix ipc suffix, use port instead

* [fix] fix prefix caching not enabled

* [fix] fix key/value_cache_scales indent

* [fix] fix ep group all-reduce

* [fix] fix clear/update lock not working when workers > 1

* [chore] add preemption triggered info log

* [fix] fix code style

* [fix] fix max_num_seqs config

* [fix] do not force enable_prefix_caching=False in dynamic loading

* [fix] fix ci

* Revert "[fix] fix ci"

This reverts commit 0bc6d55cc8.

* [fix] initialize available_gpu_block_num with max_gpu_block_num

* [fix] fix config splitwise_role

* [fix] fix clearing caches synchronization and add more logs

* [chore] print cache_ready_signal in log

* [fix] fix scheduler_config.splitwise_role

* [fix] fix cache_messager cache_ready_signal create=True

* [fix] stop cache messager from launching in mixed deployment

2025-09-28 19:42:53 +08:00

..

cache_manager

[feat] support prefix cache clearing when /clear_load_weight is called (#4008)

2025-09-28 19:42:53 +08:00

demo

[Feature] Add AsyncTokenizerClient&ChatResponseProcessor with remote encode&decode support. (#3674)

2025-08-30 17:06:26 +08:00

distributed

[Intel HPU] Support intel hpu platform (#4161)

2025-09-24 12:27:50 +08:00

engine

[feat] support prefix cache clearing when /clear_load_weight is called (#4008)

2025-09-28 19:42:53 +08:00

entrypoints

[feat] support prefix cache clearing when /clear_load_weight is called (#4008)

2025-09-28 19:42:53 +08:00

input

Support limit thinking lengths (#4069)

2025-09-25 19:55:56 +08:00

inter_communicator

[feat] support prefix cache clearing when /clear_load_weight is called (#4008)

2025-09-28 19:42:53 +08:00

logger

add error log to file (#3431)

2025-08-20 09:52:34 +08:00

metrics

[metrics] update metrics markdown file (#4061)

2025-09-12 11:13:43 +08:00

model_executor

[feat] support prefix cache clearing when /clear_load_weight is called (#4008)

2025-09-28 19:42:53 +08:00

multimodal

[MTP]Support mtp reshard (#4099)

2025-09-15 17:13:53 +08:00

output

[Intel HPU] Support intel hpu platform (#4161)

2025-09-24 12:27:50 +08:00

platforms

[Intel HPU] Support intel hpu platform (#4161)

2025-09-24 12:27:50 +08:00

plugins

[Feature] add cli command serve (#4226)

2025-09-24 14:50:45 +08:00

reasoning

[Supplements and upgrades]Improvement of X1 parsers (#4172)

2025-09-26 13:37:37 +08:00

rl

[feat] support prefix cache clearing when /clear_load_weight is called (#4008)

2025-09-28 19:42:53 +08:00

scheduler

[Feature] Support pd ep deployment with yiyan adapter (#4029)

2025-09-22 16:41:38 +08:00

spec_decode

[FDConfig]Remove splitwise_role and engine_worker_queue_port in FDConfig (#4147)

2025-09-19 17:01:52 +08:00

splitwise

[Bug fix] Fix bug for running ep (#4245)

2025-09-28 14:56:18 +08:00

transformer_utils

[Feature] support pool (#3827)

2025-09-22 14:09:09 +08:00

worker

[feat] support prefix cache clearing when /clear_load_weight is called (#4008)

2025-09-28 19:42:53 +08:00

__init__.py

[Feature] add cli command serve (#4226)

2025-09-24 14:50:45 +08:00

collect_env.py

【FastDeploy CLI】collect-env subcommand (#4044)

2025-09-15 10:31:23 +08:00

config.py

[feat] support prefix cache clearing when /clear_load_weight is called (#4008)

2025-09-28 19:42:53 +08:00

envs.py

[feat] support prefix cache clearing when /clear_load_weight is called (#4008)

2025-09-28 19:42:53 +08:00

import_ops.py

fix import error (#2944)

2025-07-22 14:06:01 +08:00

stop.sh

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

test.yaml

[Sync] Update to latest code (#2679)

2025-07-03 15:43:53 +08:00

utils.py

Add cli run batch (#4237)

2025-09-26 14:27:25 +08:00