chenjian 41cd3e24c9 [Feature] Enable prefix caching as default (#3816) ...

* [Feature] Enable prefix caching as default

* [Feature] Enable prefix caching as default

* Set prefix caching as default

* skip dynamic load

* fix kill bug

* fix kill bug

* fix kill bug

* fix ci

* fix

---------

Co-authored-by: Jiang-Jia-Jun <163579578+Jiang-Jia-Jun@users.noreply.github.com>

2025-09-06 09:51:34 +08:00

..

cache_manager

[Bug fix] Fix prefix cache in V1 (#3715)

2025-08-31 21:29:33 +08:00

demo

[Feature] Add AsyncTokenizerClient&ChatResponseProcessor with remote encode&decode support. (#3674)

2025-08-30 17:06:26 +08:00

distributed

Supports DP+TP+EP hybrid parallel deployment strategy (#3489)

2025-08-26 00:04:01 -07:00

engine

[Feature] Enable prefix caching as default (#3816)

2025-09-06 09:51:34 +08:00

entrypoints

Revert "[Feature] Setting number of apiserver workers automatically (#3794)" (#3918)

2025-09-05 21:06:50 +08:00

input

fix qwen_vl_processor miss image_patch_id (#3894)

2025-09-05 11:32:34 +08:00

inter_communicator

add input_processor plugin (#3657)

2025-08-28 22:53:57 +08:00

logger

add error log to file (#3431)

2025-08-20 09:52:34 +08:00

metrics

[feat] add metrics for yiyan adapter (#3219) (#3614)

2025-08-30 23:20:58 +08:00

model_executor

【CP】Compatible with EB 0.3B torch model arch (#3914)

2025-09-05 19:05:07 +08:00

multimodal

[Model]support qwen2_5_vl (#3557)

2025-08-29 18:28:39 +08:00

output

[feat] add metrics for yiyan adapter (#3219) (#3614)

2025-08-30 23:20:58 +08:00

platforms

[Feature] block sparse attention (#3668)

2025-08-29 19:46:30 +08:00

plugins

add reasoning parser plugin (#3820)

2025-09-03 11:17:13 +08:00

reasoning

[Feature] add tool parser (#3483)

2025-08-21 17:25:44 +08:00

rl

【BugFix】add moe noaux_tc tatics in trition backend (#3821)

2025-09-03 13:28:44 +08:00

scheduler

add error traceback info (#3419)

2025-08-19 19:32:04 +08:00

spec_decode

update hybrid-mtp-with-ngram (#3924)

2025-09-05 23:06:57 +08:00

splitwise

[feat] add metrics for yiyan adapter (#3219) (#3614)

2025-08-30 23:20:58 +08:00

worker

[Feature] Enable prefix caching as default (#3816)

2025-09-06 09:51:34 +08:00

__init__.py

[BugFix] Fix default log level of paddleformers (#3376)

2025-08-14 11:36:24 +08:00

config.py

[XPU]Fixed the issue of performance degradation caused by enabling ENABLE_V1_KVCACHE_SCHEDULER (#3900)

2025-09-05 19:17:25 +08:00

envs.py

[Feature] Set scheduler v1 as default (#3812)

2025-09-04 11:02:10 +08:00

import_ops.py

fix import error (#2944)

2025-07-22 14:06:01 +08:00

stop.sh

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

test.yaml

[Sync] Update to latest code (#2679)

2025-07-03 15:43:53 +08:00

utils.py

Revert "[Feature] Setting number of apiserver workers automatically (#3794)" (#3918)

2025-09-05 21:06:50 +08:00