chenjian ffec66097c [optimize] Optimize prefix caching in v1 release/2.1 (#3823) ...

* [optimize] Optimize prefix caching in v1

* [optimize] Optimize prefix caching in v1

---------

Co-authored-by: Jiang-Jia-Jun <163579578+Jiang-Jia-Jun@users.noreply.github.com>

2025-09-04 19:25:02 +08:00

..

cache_manager

[optimize] Optimize prefix caching in v1 release/2.1 (#3823)

2025-09-04 19:25:02 +08:00

demo

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

distributed

update flake8 version to support pre-commit in python3.12 (#3000)

2025-07-24 01:43:31 -07:00

engine

[optimize] Optimize prefix caching in v1 release/2.1 (#3823)

2025-09-04 19:25:02 +08:00

entrypoints

[BugFix] [CP] fix max streaming tokens invalid (#3798)

2025-09-02 21:03:36 +08:00

input

[Feature] Support limit thinking len for text models (#3527)

2025-08-22 14:48:15 +08:00

inter_communicator

[Fix] Do not drop result when request result slowly (#3704)

2025-09-01 10:14:04 +08:00

metrics

[feat] add metrics for yiyan adapter (#3615)

2025-08-28 21:16:58 +08:00

model_executor

check (#3866)

2025-09-03 20:46:13 +08:00

output

[Bug fix] Fix perf in mixed deployment with yiyan adpater (#3703)

2025-09-01 14:06:09 +08:00

platforms

native top_p_sampling (#2901)

2025-07-22 14:09:59 +08:00

reasoning

[Feature] add tool parser (#3518)

2025-08-22 11:14:35 +08:00

rl

fix dynamic_weight config bug (#3432)

2025-08-18 14:36:53 +08:00

scheduler

[Bug fix] Fix perf in mixed deployment with yiyan adpater (#3703)

2025-09-01 14:06:09 +08:00

spec_decode

[BugFix] support real batch_size (#3109) (#3217)

2025-08-06 14:30:33 +08:00

splitwise

[feat] add metrics for yiyan adapter (#3615)

2025-08-28 21:16:58 +08:00

worker

[CP] CP Lm head fp32 and temp_logprob to release/2.1 (#3766)

2025-09-01 19:56:54 +08:00

__init__.py

[BugFix] Fix default log level of paddleformers (#3377)

2025-08-14 11:36:13 +08:00

config.py

[CP] CP Lm head fp32 and temp_logprob to release/2.1 (#3766)

2025-09-01 19:56:54 +08:00

envs.py

[Optimize] Increase zmq buffer size to prevent apiserver too slowly to consume (#3723) (#3728)

2025-08-30 15:58:18 +08:00

import_ops.py

fix import error (#2944)

2025-07-22 14:06:01 +08:00

stop.sh

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

test.yaml

[Sync] Update to latest code (#2679)

2025-07-03 15:43:53 +08:00

utils.py

[Feature] add tool parser (#3518)

2025-08-22 11:14:35 +08:00