apps/FastDeploy
1
0
Fork 0
mirror of https://github.com/PaddlePaddle/FastDeploy.git synced 2025-10-27 10:30:34 +08:00
Code Issues Actions 5 Packages Projects Releases Wiki Activity
2,804 Commits 20 Branches 8 Tags
a84a98b1072008ebd36247295d0e2c8f1d30bed1
Commit Graph

4 Commits

Author SHA1 Message Date
ltd0924
3792345c3a [LLM] update function name (#2985) 
* [LLM] update function name
 2025-07-24 15:03:40 +08:00
Zero Rains
89a485b69f [Feature] Support using prefix-caching + cudagraph for inference (#2924) 
* fix the bug in cudagraph+prefix-caching but still have some bug with profile

Change-Id: Ibf2ba3f2e3b08641d03f4b1391d7c862c3efa397

* add the signal to make sure cache manager launched

* fix judge condition

* reomove useless control

* update control stream

* update

* fix xpu

* change the do_profile flag

* update

* add new threads to init cache_manager

---------

Co-authored-by: RAM <gstian5555@outlook.com>
 2025-07-22 00:59:45 -07:00
Zero Rains
25698d56d1 polish code with new pre-commit rule (#2923) 2025-07-19 23:19:27 +08:00
Jiang-Jia-Jun
92c2cfa2e7 Sync v2.0 version of code to github repo 2025-06-29 23:29:37 +00:00