apps/FastDeploy
1
0
Fork 0
mirror of https://github.com/PaddlePaddle/FastDeploy.git synced 2025-11-02 04:43:27 +08:00
Code Issues Actions 5 Packages Projects Releases Wiki Activity
2,628 Commits 19 Branches 8 Tags
fefbd65cf89ef364ce710437cfbd69f99c0dc9b7
Commit Graph

2628 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Jiang-Jia-Jun
cf2e50fb71 Merge pull request #2516 from kevincheng2/develop 
Update code comments
 2024-09-03 11:17:52 +08:00
kevincheng2
2637280667 update dockerfile 2024-09-02 14:04:09 +08:00
kevincheng2
4bc8dc38b0 update code comments 2024-09-02 14:04:09 +08:00
Jiang-Jia-Jun
8500f5dfec Merge pull request #2515 from kevincheng2/develop 
[LLM] Support deploy LLM model
 2024-08-29 19:47:47 +08:00
kevincheng2
10c6bded85 update README 2024-08-29 19:45:32 +08:00
chengyanfu
2d7d0ee92e [LLM] Support deploy LLM model 2024-08-29 19:38:11 +08:00
Jiang-Jia-Jun
cd0ee79c91 Merge pull request #2418 from ChaoII/develop 
[BUG FIX] fix memory leak for ort backend
 2024-04-01 17:02:09 +08:00
Jiang-Jia-Jun
3a69014c55 Merge pull request #2421 from heliqi/liqi_develop 
fix pre-commit-config
 2024-04-01 17:01:23 +08:00
heliqi
932743013c fix pre-commit-config 2024-04-01 11:53:35 +08:00
heliqi
75b0d3498b Merge branch 'PaddlePaddle:develop' into develop 2024-04-01 11:50:52 +08:00
Jiang-Jia-Jun
176701f742 Merge branch 'develop' into develop 2024-03-31 13:44:30 +08:00
Jiang-Jia-Jun
f367e1787b Merge pull request #2420 from ChaoII/link_fix 
[DOC]fix doc dead link
 2024-03-31 13:42:51 +08:00
ChaoII
df7758d400 [DOC]fix doc dead link 2024-03-29 09:29:09 +08:00
ChaoII
0ae0dc9d82 [BUG FIX] fix memory leak for ort backend 2024-03-29 09:00:05 +08:00
ChaoII
cc8d1f3c9f [BUG FIX] add export declaration of GaussianRandom function (#2379) 
* Update fd_type.cc

[bug fix]add define for destroy TwoDimArrayCstr for c_api

* [BUG FIX] add export declaration of GaussianRandom function
 2024-03-05 13:37:20 +08:00
heliqi
d197f7d7d4 update serving images (#2387) 
Co-authored-by: root <root@bjyz-sys-gpu-kongming2.bjyz.baidu.com>
 2024-03-01 11:02:28 +08:00
root
0f4c697a89 update serving images 2024-02-29 19:07:57 +08:00
Albin
1314f3267e bug fix: 修复contrib中的det模型后处理在遇到没有检测框的图时导致同batch中接下来的图片结果全部为空的bug (#2378) 2024-02-27 19:21:17 +08:00
ThinkWD
cfd80e95a1 修复 #2359 (#2363) 
Update pptinypose_utils.cc

添加 py 范围限制, 避免 utils::DarkParse 内部出现数组越界
 2024-01-29 19:16:19 +08:00
DefTruth
cfebd24dfc [Backend] fix ort backend windows build error (#2269) 
* support ort offline graph optimize option

* support ort offline graph optimize option

* [Backend] fix windows build error
 2023-11-02 12:51:46 +08:00
DefTruth
6a8cd4d759 [Backend] support ort offline graph optimize option (#2268) 
* support ort offline graph optimize option

* support ort offline graph optimize option
 2023-11-02 09:19:33 +08:00
Jason
d910d6116c [Model] Fix nms problem (#2230) 
fix nms problem
 2023-10-10 16:24:33 +08:00
Jason
aab27b3db5 Update atan2.cc 2023-09-14 20:56:33 +08:00
root
005dc860f2 remove useless space 2023-08-28 05:42:35 +00:00
root
600cf092a7 Fix empty install 2023-08-28 05:24:03 +00:00
Jason
0770f1f038 Update CMakeLists.txt 2023-08-24 18:59:10 +08:00
Jason
b24dde4cd6 Update CMakeLists.txt (#2183) 2023-08-24 17:16:42 +08:00
ChaoII
771dcf4b91 [Backend]Update sophgo_backend.cc for FP16 data type (#2161) 2023-08-16 14:12:58 +08:00
Zheng-Bicheng
4e9bcc3718 [Backend] Update RKNN Runtime libs to version "1.5.1b19" (#2156) 
* update rknpu2 runtime libs and rknntoolkit2

* update rknpu2 runtime libs
 2023-08-10 13:27:56 +08:00
DefTruth
12bb44e0de [Bug Fix] fix build xpu encrypt & auth image scripts (#2133) 
* [patchelf] fix patchelf error for inference xpu

* [serving] add xpu dockerfile and support fd server

* [serving] add xpu dockerfile and support fd server

* [Serving] support XPU + Tritron

* [Serving] support XPU + Tritron

* [Dockerfile] update xpu tritron docker file -> paddle 0.0.0

* [Dockerfile] update xpu tritron docker file -> paddle 0.0.0

* [Dockerfile] update xpu tritron docker file -> paddle 0.0.0

* [Dockerfile] add comments for xpu tritron dockerfile

* [Doruntime] fix xpu infer error

* [Doruntime] fix xpu infer error

* [XPU] update xpu dockerfile

* add xpu triton server docs

* add xpu triton server docs

* add xpu triton server docs

* add xpu triton server docs

* update xpu triton server docs

* update xpu triton server docs

* update xpu triton server docs

* update xpu triton server docs

* update xpu triton server docs

* update xpu triton server docs

* update xpu triton server docs

* update xpu triton server docs

* [XPU] Update XPU L3 Cache setting docs

* [XPU] Add Encryption and AUTH support for XPU Server

* [XPU] Add Encryption and AUTH support for XPU Server

* [Bug Fix] fix paddle reader error

* [Serving] Support XPU encrypt & auth server

* [Serving] Support XPU encrypt & auth server

* [Serving] Support XPU encrypt & auth server

* [Serving] Support XPU encrypt & auth server

* [Triton] switch TAG 22.12 -> TAG 21.10wq

* update xpu auth server script

* [Bug Fix] fix build xpu encrypt & auth image scripts
 2023-07-24 21:00:05 +08:00
DefTruth
ade27d29cb [Sync][Internal] sync some internal features of paddle3d inference (#2118) 
* [Sync][Internal] sync some internal codes

* [Sync][Internal] sync some internal features of paddle3d inference

* [Sync][Internal] sync some internal features of paddle3d inference
 2023-07-17 23:06:51 +08:00
Jason
f413e0263b [Bug] Fix build error (#2112) 
Fix build paddle2onnx error
 2023-07-17 10:49:50 +08:00
DefTruth
681ccc4c24 [Sync][Internal] sync some internal paddle3d codes (#2108) 2023-07-13 22:06:28 +08:00
DefTruth
77ee48f9b8 [Bug Fix] fixed compile error for cpu building (#2105) 
* [cmake] upgrade windows paddle inference -> 2.5.0

* [cmake] upgrade windows paddle inference -> 2.5.0

* fix paddle custom ops bug on windows

* [Backend] refactor paddle custom ops

* [Bug Fix] fixed paddle custom ops windows build error

* [Bug Fix] fixed compile error for cpu building
 2023-07-13 17:02:25 +08:00
DefTruth
d5ad3d9c8d [Bug Fix] fixed paddle custom ops windows build error (#2103) 
* [cmake] upgrade windows paddle inference -> 2.5.0

* [cmake] upgrade windows paddle inference -> 2.5.0

* fix paddle custom ops bug on windows

* [Backend] refactor paddle custom ops

* [Bug Fix] fixed paddle custom ops windows build error
 2023-07-13 14:04:01 +08:00
DefTruth
99c2b6592d [Backend] refactor paddle custom ops -> fastdeploy::paddle_custom_ops (#2101) 
* [cmake] upgrade windows paddle inference -> 2.5.0

* [cmake] upgrade windows paddle inference -> 2.5.0

* fix paddle custom ops bug on windows

* [Backend] refactor paddle custom ops
 2023-07-13 09:00:03 +08:00
DefTruth
2542a75b61 [cmake] upgrade windows paddle inference -> 2.5.0 (#2100) 
* [cmake] upgrade windows paddle inference -> 2.5.0

* [cmake] upgrade windows paddle inference -> 2.5.0

* fix paddle custom ops bug on windows
 2023-07-12 18:39:06 +08:00
zengshao0622
c95fc1fba8 [Bug Fix] fix centerpoint malloc bug (#2099) 2023-07-12 17:17:22 +08:00
DefTruth
cf1ff2077d [Bug Fix] fix trt backend page-locked error (#2095) 
* [Bug Fix] fix trt backend page-locked error

* Update trt_backend.cc
 2023-07-11 13:49:47 +08:00
DefTruth
4c1e80b723 [Bug Fix] fixed ocr visualize error (#2090) 2023-07-07 17:43:08 +08:00
yeliang2258
ad1f46f7d9 Add ORT fp16 support in server (#2069) 
* add ort fp16 support in server

* update paddle2onnx url

* update ort fp16 api

* add disable_ort_fp16_op_types in serving
 2023-07-05 17:50:00 +08:00
jack xu
821adb387e [Bug Fix] Fixed the issue with the incorrect path to FastDeploy.cmake in CMakeLists.txt file. (#2082) 
[Bug Fix] fixed CMakeLists.txt FastDeploy.cmake path
 2023-07-04 13:04:19 +08:00
zengshao0622
79a3587339 [Model] Add Paddle3D CenterPoint model (#2078) 
* add centerpoint

* update for review comments
 2023-07-03 13:39:16 +08:00
DefTruth
b2426aefa9 [Backend] add paddle custom ops compatible policy (#2070) 
* Add centerpoint

* fix postprocess op file name

* [Backend] add paddle custom ops compatible policy

* [Backend] add paddle custom ops compatible policy

* [Backend] add paddle custom ops compatible policy

* upgrade linx paddle gpu -> 2.5

* add custom op compatible policy for paddle 2.5

* add custom op compatible policy for paddle 2.5

* add custom op compatible policy for paddle 2.5

* add collect_trt_shape_by_device option for paddle backend

* add collect_trt_shape_by_device option for paddle backend

* add custom op option for python build

* fix python build bugs

* update paddle linux x86 cpu only lib

* update paddle linux gpu lib

* update patchelf cmake

* fix paddle backend option pybind

* update paddle_inference.cmake

* add cuda sm_80 support (A100)

---------

Co-authored-by: zengshao0622 <peter_z96@163.com>
Co-authored-by: qiuyanjun <qiuyanjun@baidu.com>
 2023-06-29 22:32:14 +08:00
JugendTraum
4c3e7030e1 Update rknpu2_backend.cc (#2064) 
Update rknpu2_backend.cc  Signed-off-by: JugendTraum <443248173@qq.com>

Co-authored-by: DefTruth <31974251+DefTruth@users.noreply.github.com>
 2023-06-26 04:58:12 -07:00
zengshao0622
709ba51612 [WIP]Add VI-LayoutXLM (#2048) 
* WIP, add VI-LayoutXLM

* fix pybind

* update the dir of ser_vi_layoutxlm model

* update dir and name of ser_vi_layoutxlm model

* update model name to StructureV2SerViLayoutXLMModel

* fix import paddle bug

---------

Co-authored-by: DefTruth <31974251+DefTruth@users.noreply.github.com>
 2023-06-26 16:40:05 +08:00
DefTruth
90e4fccbf8 [benchmark] update paddlex2.0 benchmark scripts (#2063) 
* [Backend] Add backward compatiable for paddle infernence 2.4.x

* [Backend] Add backward compatiable for paddle infernence 2.4.x

* [benchmark] update paddlex2.0 benchmark scripts
 2023-06-25 19:45:43 +08:00
DefTruth
dea3795930 [Backend] Add backward compatible for paddle inference 2.4.x (#2062) 
* [Backend] Add backward compatiable for paddle infernence 2.4.x

* [Backend] Add backward compatiable for paddle infernence 2.4.x
 2023-06-25 19:27:36 +08:00
DefTruth
ba8649a69d [Model] update PP-ShiTuV2-rec preprocess parser policy (#2061) 
* [benchmark] fixed paddlex benchmark for picodet 320

* [Bug Fix] fixed paddlex ppseg pp-trt infer error

* [Bug Fix] fixed paddlex dino benchmark trt shapes

* [benchmark] support paddlex ppyoloe pptrt benchmark

* [benchmark] adjust paddlex dino trt shapes

* [benchmark] add max_workspace_size flags for tensorrt/pptrt backend

* [benchmark] add max_workspace_size flags for tensorrt/pptrt backend

* [benchmark] add max_workspace_size flags for tensorrt/pptrt backend

* [benchmark] add ort/paddle h2d gpu configs for paddlex

* [benchmark] update paddlex benchmark scripts

* [benchmark] update paddlex benchmark scripts

* [Model] update PP-ShituV2-rec preprocess parser policy

---------

Co-authored-by: qiuyanjun <qiuyanjun@baidu.com>
 2023-06-25 13:50:02 +08:00
DefTruth
4aff3221fd [benchmark] update paddlex benchmark scripts (#2060) 
* [benchmark] fixed paddlex benchmark for picodet 320

* [Bug Fix] fixed paddlex ppseg pp-trt infer error

* [Bug Fix] fixed paddlex dino benchmark trt shapes

* [benchmark] support paddlex ppyoloe pptrt benchmark

* [benchmark] adjust paddlex dino trt shapes

* [benchmark] add max_workspace_size flags for tensorrt/pptrt backend

* [benchmark] add max_workspace_size flags for tensorrt/pptrt backend

* [benchmark] add max_workspace_size flags for tensorrt/pptrt backend

* [benchmark] add ort/paddle h2d gpu configs for paddlex

* [benchmark] update paddlex benchmark scripts

* [benchmark] update paddlex benchmark scripts

---------

Co-authored-by: qiuyanjun <qiuyanjun@baidu.com>
 2023-06-22 18:30:01 +08:00