apps/FastDeploy
1
0
Fork 0
mirror of https://github.com/PaddlePaddle/FastDeploy.git synced 2025-10-11 03:20:20 +08:00
Code Issues Actions 6 Packages Projects Releases Wiki Activity
3,104 Commits 25 Branches 8 Tags
56e2d7e6683ecef34684fd07cd49b7adeaa23f5c
Commit Graph

3104 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
root
600cf092a7 Fix empty install 2023-08-28 05:24:03 +00:00
Jason
0770f1f038 Update CMakeLists.txt 2023-08-24 18:59:10 +08:00
Jason
b24dde4cd6 Update CMakeLists.txt (#2183) 2023-08-24 17:16:42 +08:00
ChaoII
771dcf4b91 [Backend]Update sophgo_backend.cc for FP16 data type (#2161) 2023-08-16 14:12:58 +08:00
Zheng-Bicheng
4e9bcc3718 [Backend] Update RKNN Runtime libs to version "1.5.1b19" (#2156) 
* update rknpu2 runtime libs and rknntoolkit2

* update rknpu2 runtime libs
 2023-08-10 13:27:56 +08:00
DefTruth
12bb44e0de [Bug Fix] fix build xpu encrypt & auth image scripts (#2133) 
* [patchelf] fix patchelf error for inference xpu

* [serving] add xpu dockerfile and support fd server

* [serving] add xpu dockerfile and support fd server

* [Serving] support XPU + Tritron

* [Serving] support XPU + Tritron

* [Dockerfile] update xpu tritron docker file -> paddle 0.0.0

* [Dockerfile] update xpu tritron docker file -> paddle 0.0.0

* [Dockerfile] update xpu tritron docker file -> paddle 0.0.0

* [Dockerfile] add comments for xpu tritron dockerfile

* [Doruntime] fix xpu infer error

* [Doruntime] fix xpu infer error

* [XPU] update xpu dockerfile

* add xpu triton server docs

* add xpu triton server docs

* add xpu triton server docs

* add xpu triton server docs

* update xpu triton server docs

* update xpu triton server docs

* update xpu triton server docs

* update xpu triton server docs

* update xpu triton server docs

* update xpu triton server docs

* update xpu triton server docs

* update xpu triton server docs

* [XPU] Update XPU L3 Cache setting docs

* [XPU] Add Encryption and AUTH support for XPU Server

* [XPU] Add Encryption and AUTH support for XPU Server

* [Bug Fix] fix paddle reader error

* [Serving] Support XPU encrypt & auth server

* [Serving] Support XPU encrypt & auth server

* [Serving] Support XPU encrypt & auth server

* [Serving] Support XPU encrypt & auth server

* [Triton] switch TAG 22.12 -> TAG 21.10wq

* update xpu auth server script

* [Bug Fix] fix build xpu encrypt & auth image scripts
 2023-07-24 21:00:05 +08:00
DefTruth
ade27d29cb [Sync][Internal] sync some internal features of paddle3d inference (#2118) 
* [Sync][Internal] sync some internal codes

* [Sync][Internal] sync some internal features of paddle3d inference

* [Sync][Internal] sync some internal features of paddle3d inference
 2023-07-17 23:06:51 +08:00
Jason
f413e0263b [Bug] Fix build error (#2112) 
Fix build paddle2onnx error
 2023-07-17 10:49:50 +08:00
DefTruth
681ccc4c24 [Sync][Internal] sync some internal paddle3d codes (#2108) 2023-07-13 22:06:28 +08:00
DefTruth
77ee48f9b8 [Bug Fix] fixed compile error for cpu building (#2105) 
* [cmake] upgrade windows paddle inference -> 2.5.0

* [cmake] upgrade windows paddle inference -> 2.5.0

* fix paddle custom ops bug on windows

* [Backend] refactor paddle custom ops

* [Bug Fix] fixed paddle custom ops windows build error

* [Bug Fix] fixed compile error for cpu building
 2023-07-13 17:02:25 +08:00
DefTruth
d5ad3d9c8d [Bug Fix] fixed paddle custom ops windows build error (#2103) 
* [cmake] upgrade windows paddle inference -> 2.5.0

* [cmake] upgrade windows paddle inference -> 2.5.0

* fix paddle custom ops bug on windows

* [Backend] refactor paddle custom ops

* [Bug Fix] fixed paddle custom ops windows build error
 2023-07-13 14:04:01 +08:00
DefTruth
99c2b6592d [Backend] refactor paddle custom ops -> fastdeploy::paddle_custom_ops (#2101) 
* [cmake] upgrade windows paddle inference -> 2.5.0

* [cmake] upgrade windows paddle inference -> 2.5.0

* fix paddle custom ops bug on windows

* [Backend] refactor paddle custom ops
 2023-07-13 09:00:03 +08:00
DefTruth
2542a75b61 [cmake] upgrade windows paddle inference -> 2.5.0 (#2100) 
* [cmake] upgrade windows paddle inference -> 2.5.0

* [cmake] upgrade windows paddle inference -> 2.5.0

* fix paddle custom ops bug on windows
 2023-07-12 18:39:06 +08:00
zengshao0622
c95fc1fba8 [Bug Fix] fix centerpoint malloc bug (#2099) 2023-07-12 17:17:22 +08:00
DefTruth
cf1ff2077d [Bug Fix] fix trt backend page-locked error (#2095) 
* [Bug Fix] fix trt backend page-locked error

* Update trt_backend.cc
 2023-07-11 13:49:47 +08:00
DefTruth
4c1e80b723 [Bug Fix] fixed ocr visualize error (#2090) 2023-07-07 17:43:08 +08:00
yeliang2258
ad1f46f7d9 Add ORT fp16 support in server (#2069) 
* add ort fp16 support in server

* update paddle2onnx url

* update ort fp16 api

* add disable_ort_fp16_op_types in serving
 2023-07-05 17:50:00 +08:00
jack xu
821adb387e [Bug Fix] Fixed the issue with the incorrect path to FastDeploy.cmake in CMakeLists.txt file. (#2082) 
[Bug Fix] fixed CMakeLists.txt FastDeploy.cmake path
 2023-07-04 13:04:19 +08:00
zengshao0622
79a3587339 [Model] Add Paddle3D CenterPoint model (#2078) 
* add centerpoint

* update for review comments
 2023-07-03 13:39:16 +08:00
DefTruth
b2426aefa9 [Backend] add paddle custom ops compatible policy (#2070) 
* Add centerpoint

* fix postprocess op file name

* [Backend] add paddle custom ops compatible policy

* [Backend] add paddle custom ops compatible policy

* [Backend] add paddle custom ops compatible policy

* upgrade linx paddle gpu -> 2.5

* add custom op compatible policy for paddle 2.5

* add custom op compatible policy for paddle 2.5

* add custom op compatible policy for paddle 2.5

* add collect_trt_shape_by_device option for paddle backend

* add collect_trt_shape_by_device option for paddle backend

* add custom op option for python build

* fix python build bugs

* update paddle linux x86 cpu only lib

* update paddle linux gpu lib

* update patchelf cmake

* fix paddle backend option pybind

* update paddle_inference.cmake

* add cuda sm_80 support (A100)

---------

Co-authored-by: zengshao0622 <peter_z96@163.com>
Co-authored-by: qiuyanjun <qiuyanjun@baidu.com>
 2023-06-29 22:32:14 +08:00
JugendTraum
4c3e7030e1 Update rknpu2_backend.cc (#2064) 
Update rknpu2_backend.cc  Signed-off-by: JugendTraum <443248173@qq.com>

Co-authored-by: DefTruth <31974251+DefTruth@users.noreply.github.com>
 2023-06-26 04:58:12 -07:00
zengshao0622
709ba51612 [WIP]Add VI-LayoutXLM (#2048) 
* WIP, add VI-LayoutXLM

* fix pybind

* update the dir of ser_vi_layoutxlm model

* update dir and name of ser_vi_layoutxlm model

* update model name to StructureV2SerViLayoutXLMModel

* fix import paddle bug

---------

Co-authored-by: DefTruth <31974251+DefTruth@users.noreply.github.com>
 2023-06-26 16:40:05 +08:00
DefTruth
90e4fccbf8 [benchmark] update paddlex2.0 benchmark scripts (#2063) 
* [Backend] Add backward compatiable for paddle infernence 2.4.x

* [Backend] Add backward compatiable for paddle infernence 2.4.x

* [benchmark] update paddlex2.0 benchmark scripts
 2023-06-25 19:45:43 +08:00
DefTruth
dea3795930 [Backend] Add backward compatible for paddle inference 2.4.x (#2062) 
* [Backend] Add backward compatiable for paddle infernence 2.4.x

* [Backend] Add backward compatiable for paddle infernence 2.4.x
 2023-06-25 19:27:36 +08:00
DefTruth
ba8649a69d [Model] update PP-ShiTuV2-rec preprocess parser policy (#2061) 
* [benchmark] fixed paddlex benchmark for picodet 320

* [Bug Fix] fixed paddlex ppseg pp-trt infer error

* [Bug Fix] fixed paddlex dino benchmark trt shapes

* [benchmark] support paddlex ppyoloe pptrt benchmark

* [benchmark] adjust paddlex dino trt shapes

* [benchmark] add max_workspace_size flags for tensorrt/pptrt backend

* [benchmark] add max_workspace_size flags for tensorrt/pptrt backend

* [benchmark] add max_workspace_size flags for tensorrt/pptrt backend

* [benchmark] add ort/paddle h2d gpu configs for paddlex

* [benchmark] update paddlex benchmark scripts

* [benchmark] update paddlex benchmark scripts

* [Model] update PP-ShituV2-rec preprocess parser policy

---------

Co-authored-by: qiuyanjun <qiuyanjun@baidu.com>
 2023-06-25 13:50:02 +08:00
DefTruth
4aff3221fd [benchmark] update paddlex benchmark scripts (#2060) 
* [benchmark] fixed paddlex benchmark for picodet 320

* [Bug Fix] fixed paddlex ppseg pp-trt infer error

* [Bug Fix] fixed paddlex dino benchmark trt shapes

* [benchmark] support paddlex ppyoloe pptrt benchmark

* [benchmark] adjust paddlex dino trt shapes

* [benchmark] add max_workspace_size flags for tensorrt/pptrt backend

* [benchmark] add max_workspace_size flags for tensorrt/pptrt backend

* [benchmark] add max_workspace_size flags for tensorrt/pptrt backend

* [benchmark] add ort/paddle h2d gpu configs for paddlex

* [benchmark] update paddlex benchmark scripts

* [benchmark] update paddlex benchmark scripts

---------

Co-authored-by: qiuyanjun <qiuyanjun@baidu.com>
 2023-06-22 18:30:01 +08:00
DefTruth
a180fb3c8f [benchmark] add ort/paddle h2d gpu configs for paddlex (#2059) 
* [benchmark] fixed paddlex benchmark for picodet 320

* [Bug Fix] fixed paddlex ppseg pp-trt infer error

* [Bug Fix] fixed paddlex dino benchmark trt shapes

* [benchmark] support paddlex ppyoloe pptrt benchmark

* [benchmark] adjust paddlex dino trt shapes

* [benchmark] add max_workspace_size flags for tensorrt/pptrt backend

* [benchmark] add max_workspace_size flags for tensorrt/pptrt backend

* [benchmark] add max_workspace_size flags for tensorrt/pptrt backend

* [benchmark] add ort/paddle h2d gpu configs for paddlex

---------

Co-authored-by: qiuyanjun <qiuyanjun@baidu.com>
 2023-06-22 17:48:37 +08:00
DefTruth
ff835690a2 [benchmark] add max_workspace_size flags for tensorrt/pptrt backend (#2058) 
* [benchmark] fixed paddlex benchmark for picodet 320

* [Bug Fix] fixed paddlex ppseg pp-trt infer error

* [Bug Fix] fixed paddlex dino benchmark trt shapes

* [benchmark] support paddlex ppyoloe pptrt benchmark

* [benchmark] adjust paddlex dino trt shapes

* [benchmark] add max_workspace_size flags for tensorrt/pptrt backend

* [benchmark] add max_workspace_size flags for tensorrt/pptrt backend

* [benchmark] add max_workspace_size flags for tensorrt/pptrt backend

---------

Co-authored-by: qiuyanjun <qiuyanjun@baidu.com>
 2023-06-22 16:43:39 +08:00
DefTruth
269d65a9bb [benchmark] adjust paddlex dino trt shapes (#2057) 
* [benchmark] fixed paddlex benchmark for picodet 320

* [Bug Fix] fixed paddlex ppseg pp-trt infer error

* [Bug Fix] fixed paddlex dino benchmark trt shapes

* [benchmark] support paddlex ppyoloe pptrt benchmark

* [benchmark] adjust paddlex dino trt shapes

---------

Co-authored-by: qiuyanjun <qiuyanjun@baidu.com>
 2023-06-22 15:59:26 +08:00
DefTruth
c503298f87 [benchmark] support paddlex ppyoloe pptrt benchmark (#2055) 
* [benchmark] fixed paddlex benchmark for picodet 320

* [Bug Fix] fixed paddlex ppseg pp-trt infer error

* [Bug Fix] fixed paddlex dino benchmark trt shapes

* [benchmark] support paddlex ppyoloe pptrt benchmark

---------

Co-authored-by: qiuyanjun <qiuyanjun@baidu.com>
 2023-06-21 18:40:00 +08:00
DefTruth
5b8a3b498d [Bug Fix] fixed fd server use_paddle parameter parse policy (#2044) 
* [Server] Support GPU encrypt & auth for FD Triton Server

* fix dockerfile proxy env error

* update build scrpits

* remove some logs

* [Bug Fix] fixed fd server use_paddle parameter parse policy

* optimize paddle-trt policy

* optimize paddle-trt policy

---------

Co-authored-by: root <root@yq02-sys-rpm1206692e6.yq02.baidu.com>
Co-authored-by: qiuyanjun <qiuyanjun@baidu.com>
 2023-06-21 15:44:32 +08:00
DefTruth
e171710044 [Bug Fix] fixed paddlex dino benchmark trt shapes (#2050) 
* [benchmark] fixed paddlex benchmark for picodet 320

* [Bug Fix] fixed paddlex ppseg pp-trt infer error

* [Bug Fix] fixed paddlex dino benchmark trt shapes

---------

Co-authored-by: qiuyanjun <qiuyanjun@baidu.com>
 2023-06-21 00:07:22 +08:00
DefTruth
f5bea8bf37 [Bug Fix] fixed paddlex ppseg pp-trt infer error (#2049) 
* [benchmark] fixed paddlex benchmark for picodet 320

* [Bug Fix] fixed paddlex ppseg pp-trt infer error
 2023-06-20 23:24:31 +08:00
DefTruth
1144e0a484 [benchmark] fixed paddlex benchmark for picodet 320 (#2046) 2023-06-20 14:14:22 +08:00
Horror Proton
7191d2da20 [Backend] Remove deprecated ort api (#2034) 
* [Backend] Remove deprecated ort api

`Ort::CustomOpApi` deprecated in ONNXRuntime 1.15

fix https://github.com/PaddlePaddle/FastDeploy/issues/2033

* Improve compatibly with ort older than 1.14

* Update fastdeploy/runtime/backends/ort/ops/multiclass_nms.cc

Co-authored-by: Horror Proton <107091537+horror-proton@users.noreply.github.com>

* Fix double free and wrong attrib type in ort/ops

---------

Co-authored-by: Jason <928090362@qq.com>
 2023-06-15 21:35:58 +08:00
DefTruth
ff631b7838 [Server] Support encrypt & auth for FD Server (#2018) 
* [Server] Support GPU encrypt & auth for FD Triton Server

* fix dockerfile proxy env error

* update build scrpits

* remove some logs

---------

Co-authored-by: root <root@yq02-sys-rpm1206692e6.yq02.baidu.com>
Co-authored-by: qiuyanjun <qiuyanjun@baidu.com>
 2023-06-13 20:44:25 +08:00
Jason
73f42e36be [Pybind] Try to fix xpu with Set External Data support copy (#2022) 
Set External Data support copy
 2023-06-09 15:47:40 +08:00
YuBinglei
5f9e8b6e08 [Bug Fix] Re-Fix OCR Serving bug. #1516 (#2011) 
see https://github.com/PaddlePaddle/FastDeploy/pull/1516

Co-authored-by: DefTruth <31974251+DefTruth@users.noreply.github.com>
 2023-06-09 13:44:55 +08:00
Wang Bojun
7b58387d3c add option for inference precision and cutlass (#2017) 
* add option for inference precision and cutlass

* code clean

* code refine

* code refine
 2023-06-09 10:20:48 +08:00
DefTruth
147060ac60 [benchmark] add paddlex benchmark run scripts (#2015) 2023-06-05 23:19:05 +08:00
Zheng-Bicheng
8d357814e8 [Backend] Add pybind & PaddleDetection example for TVM (#1998) 
* update

* update

* Update infer_ppyoloe_demo.cc

---------

Co-authored-by: DefTruth <31974251+DefTruth@users.noreply.github.com>
 2023-06-04 13:26:47 +08:00
CoolCola
c634a9260d [Benchmark] support CLIP and DINO (#2014) 
* support ocrv4 det

* add clip dino
 2023-06-02 19:01:56 +08:00
CoolCola
05b3c1febd [Benchmark]support ocrv4 det (#2013) 
support ocrv4 det
 2023-06-02 17:32:29 +08:00
DefTruth
126ac9e915 [Bug Fix] fixed runtime benchmark bin error (#2010) 2023-06-02 14:45:31 +08:00
DefTruth
de8f0fe1f2 [Cherry Pick][benchmark] Pick PaddleX benchmark codes from <- paddlex (#2009) 
[benchmark] add paddlex benchmark codes
 2023-06-02 11:14:49 +08:00
DefTruth
284b1b46c8 [Serving] Support XPU encrypt & auth server (#2007) 
* [patchelf] fix patchelf error for inference xpu

* [serving] add xpu dockerfile and support fd server

* [serving] add xpu dockerfile and support fd server

* [Serving] support XPU + Tritron

* [Serving] support XPU + Tritron

* [Dockerfile] update xpu tritron docker file -> paddle 0.0.0

* [Dockerfile] update xpu tritron docker file -> paddle 0.0.0

* [Dockerfile] update xpu tritron docker file -> paddle 0.0.0

* [Dockerfile] add comments for xpu tritron dockerfile

* [Doruntime] fix xpu infer error

* [Doruntime] fix xpu infer error

* [XPU] update xpu dockerfile

* add xpu triton server docs

* add xpu triton server docs

* add xpu triton server docs

* add xpu triton server docs

* update xpu triton server docs

* update xpu triton server docs

* update xpu triton server docs

* update xpu triton server docs

* update xpu triton server docs

* update xpu triton server docs

* update xpu triton server docs

* update xpu triton server docs

* [XPU] Update XPU L3 Cache setting docs

* [XPU] Add Encryption and AUTH support for XPU Server

* [XPU] Add Encryption and AUTH support for XPU Server

* [Bug Fix] fix paddle reader error

* [Serving] Support XPU encrypt & auth server

* [Serving] Support XPU encrypt & auth server

* [Serving] Support XPU encrypt & auth server

* [Serving] Support XPU encrypt & auth server

* [Triton] switch TAG 22.12 -> TAG 21.10wq

* update xpu auth server script
 2023-06-01 21:36:44 +08:00
DefTruth
387c5695b3 [XPU] Update XPU L3 Cache setting docs (#2001) 
* [patchelf] fix patchelf error for inference xpu

* [serving] add xpu dockerfile and support fd server

* [serving] add xpu dockerfile and support fd server

* [Serving] support XPU + Tritron

* [Serving] support XPU + Tritron

* [Dockerfile] update xpu tritron docker file -> paddle 0.0.0

* [Dockerfile] update xpu tritron docker file -> paddle 0.0.0

* [Dockerfile] update xpu tritron docker file -> paddle 0.0.0

* [Dockerfile] add comments for xpu tritron dockerfile

* [Doruntime] fix xpu infer error

* [Doruntime] fix xpu infer error

* [XPU] update xpu dockerfile

* add xpu triton server docs

* add xpu triton server docs

* add xpu triton server docs

* add xpu triton server docs

* update xpu triton server docs

* update xpu triton server docs

* update xpu triton server docs

* update xpu triton server docs

* update xpu triton server docs

* update xpu triton server docs

* update xpu triton server docs

* update xpu triton server docs

* [XPU] Update XPU L3 Cache setting docs
 2023-05-30 11:21:04 +08:00
DefTruth
434b48dda5 [Serving] Support FastDeploy XPU Triton Server (#1994) 
* [patchelf] fix patchelf error for inference xpu

* [serving] add xpu dockerfile and support fd server

* [serving] add xpu dockerfile and support fd server

* [Serving] support XPU + Tritron

* [Serving] support XPU + Tritron

* [Dockerfile] update xpu tritron docker file -> paddle 0.0.0

* [Dockerfile] update xpu tritron docker file -> paddle 0.0.0

* [Dockerfile] update xpu tritron docker file -> paddle 0.0.0

* [Dockerfile] add comments for xpu tritron dockerfile

* [Doruntime] fix xpu infer error

* [Doruntime] fix xpu infer error

* [XPU] update xpu dockerfile

* add xpu triton server docs

* add xpu triton server docs

* add xpu triton server docs

* add xpu triton server docs

* update xpu triton server docs

* update xpu triton server docs

* update xpu triton server docs

* update xpu triton server docs

* update xpu triton server docs

* update xpu triton server docs

* update xpu triton server docs

* update xpu triton server docs
 2023-05-29 14:38:25 +08:00
co63oc
3a9904411a [C API] Fix some c api document typos (#1997) 2023-05-29 13:43:54 +08:00
Zheng-Bicheng
643730bf5f [Hackathon 181] Add TVM support for FastDeploy on macOS (#1969) 
* update for tvm backend

* update third_party

* update third_party

* update

* update

* update

* update

* update

* update

* update

* update

---------

Co-authored-by: DefTruth <31974251+DefTruth@users.noreply.github.com>
 2023-05-25 19:59:02 +08:00