李泳桦
6265f4385f
[feat] support prefix cache clearing when /clear_load_weight is called (#4008)
* [feat] support clearing prefix cache (cherry-picked from release/2.1)
* [fix] fix ipc suffix, use port instead
* [fix] fix prefix caching not enabled
* [fix] fix key/value_cache_scales indent
* [fix] fix ep group all-reduce
* [fix] fix clear/update lock not working when workers > 1
* [chore] add preemption triggered info log
* [fix] fix code style
* [fix] fix max_num_seqs config
* [fix] do not force enable_prefix_caching=False in dynamic loading
* [fix] fix ci
* Revert "[fix] fix ci"
This reverts commit 0bc6d55cc8.
* [fix] initialize available_gpu_block_num with max_gpu_block_num
* [fix] fix config splitwise_role
* [fix] fix clearing caches synchronization and add more logs
* [chore] print cache_ready_signal in log
* [fix] fix scheduler_config.splitwise_role
* [fix] fix cache_messager cache_ready_signal create=True
* [fix] stop cache messager from launching in mixed deployment
2025-09-28 19:42:53 +08:00
..
2025-09-27 09:25:43 +08:00
2025-07-19 23:19:27 +08:00
2025-09-22 14:27:17 +08:00
2025-09-01 17:50:17 +08:00
2025-09-01 17:50:17 +08:00
2025-08-05 12:20:48 +08:00
2025-07-19 23:19:27 +08:00
2025-09-01 17:50:17 +08:00
2025-09-15 12:01:34 +08:00
2025-09-11 10:46:09 +08:00
2025-09-08 15:22:41 +08:00
2025-09-17 20:24:53 +08:00
2025-09-24 16:39:51 +08:00
2025-08-14 22:40:44 +08:00
2025-09-07 10:24:58 +08:00
2025-09-02 19:17:01 +08:00
2025-08-19 02:54:47 -07:00
2025-09-07 20:41:29 -07:00
2025-09-23 18:41:33 +08:00
2025-09-11 10:46:09 +08:00
2025-08-01 17:28:07 +08:00
2025-09-03 10:54:34 +08:00
2025-07-22 15:03:41 +08:00
2025-07-30 16:05:55 +08:00
2025-07-19 23:19:27 +08:00
2025-08-14 22:40:44 +08:00
2025-09-19 14:07:31 +08:00
2025-09-10 13:11:57 +08:00
2025-07-22 15:03:41 +08:00
2025-09-24 16:39:51 +08:00
2025-07-19 23:19:27 +08:00
2025-08-01 18:03:36 +08:00
2025-07-19 23:19:27 +08:00
2025-09-11 10:46:09 +08:00
2025-09-23 18:41:33 +08:00
2025-09-23 18:41:33 +08:00
2025-08-28 10:52:53 +08:00
2025-07-19 23:19:27 +08:00
2025-07-19 23:19:27 +08:00
2025-08-18 20:21:25 +08:00
2025-09-04 17:39:59 +08:00
2025-07-19 23:19:27 +08:00
2025-07-19 23:19:27 +08:00
2025-09-01 17:50:17 +08:00
2025-09-01 17:50:17 +08:00
2025-08-29 11:04:04 +08:00
2025-09-03 10:54:34 +08:00
2025-07-19 23:19:27 +08:00
2025-09-01 17:50:17 +08:00
2025-07-19 23:19:27 +08:00
2025-07-29 14:17:37 +08:00
2025-07-19 23:19:27 +08:00
2025-09-10 13:11:57 +08:00
2025-09-10 13:11:57 +08:00
2025-07-30 09:31:29 +08:00
2025-09-01 17:50:17 +08:00
2025-07-19 23:19:27 +08:00
2025-09-28 19:42:53 +08:00
2025-07-19 23:19:27 +08:00
2025-09-22 16:41:38 +08:00
2025-09-01 17:50:17 +08:00