apps/FastDeploy
1
0
Fork 0
mirror of https://github.com/PaddlePaddle/FastDeploy.git synced 2025-10-05 16:48:03 +08:00
Code Issues Actions 2 Packages Projects Releases Wiki Activity
892 Commits 23 Branches 7 Tags
85e1c647f63eade56c947762e4adb37ebc0b2f18
Commit Graph

40 Commits

Author SHA1 Message Date
huangjianhui
85e1c647f6 [Doc] Add comments for PPSeg && PPClas (#396) 
* Add comment for PPSeg && PPClas

* Update main_page.md
 2022-10-19 16:54:39 +08:00
Wang Xinyu
c8d6c8244e [Model] Yolov5/v5lite/v6/v7/v7end2end: CUDA preprocessing (#370) 
* add yolo cuda preprocessing

* cmake build cuda src

* yolov5 support cuda preprocessing

* yolov5 cuda preprocessing configurable

* yolov5 update get mat data api

* yolov5 check cuda preprocess args

* refactor cuda function name

* yolo cuda preprocess padding value configurable

* yolov5 release cuda memory

* cuda preprocess pybind api update

* move use_cuda_preprocessing option to yolov5 model

* yolov5lite cuda preprocessing

* yolov6 cuda preprocessing

* yolov7 cuda preprocessing

* yolov7_e2e cuda preprocessing

* remove cuda preprocessing in runtime option

* refine log and cmake variable name

* fix model runtime ptr type

Co-authored-by: Jason <jiangjiajun@baidu.com>
 2022-10-19 16:04:58 +08:00
Jack Zhou
173bbf5af4 [Backend] Integrate TensorRT in Paddle Inference backend by default (#381) 
* Modify filter of trt

* Add Note for trt libs

* Use paddle inference with trt package

Co-authored-by: Jason <jiangjiajun@baidu.com>
 2022-10-18 15:29:06 +08:00
WJJ1995
f5c94e5471 Support Poros Backend (#188) 
* Add poros backend

* Add torch lib

* Add python3 lib

* set c++ 14 for poros

* fixed bugs

* fixed grammer bugs

* fixed grammer bugs

* fixed code bugs

* fixed code bugs

* fixed CreatePorosValue bug

* Add AtType2String for Log

* fixed trt_option

* fixed poros.cmake path

* fixed grammer bug

* fixed grammer bug

* fixed ambiguous reference

* fixed ambiguous reference

* fixed reference error

* fixed include files

* rm ENABLE_TRT_BACKEND in poros

* update CMakeLists.txt

* fixed CMakeLists.txt

* Add libtorch.so in CMakeLists.txt

* Fixed CMakeLists.txt

* Fixed CMakeLists.txt

* Fixed copy bug

* Fixed copy bug

* Fixed copy bug

* Fixed Cmake

* Fixed Cmake

* debug

* debug

* debug

* debug

* debug

* debug

* debug utils

* debug utils

* copy to cpu

* rm log info

* test share mem

* test share mem

* test share mem

* test multi outputs

* test multi outputs

* test multi outputs

* test multi outputs

* test multi outputs

* test multi outputs

* test multi outputs

* time cost

* time cost

* fixed bug

* time collect

* mem copy

* mem copy

* rm time log

* rm share mem

* fixed multi inputs bug

* add set_input_dtypes func

* add SetInputDtypes

* fixed bug

* fixed bug

* fixed prewarm data order

* debug

* debug

* debug

* debug

* debug

* debug

* debug

* debug

* debug

* debug

* debug

* fixed bug

* Add compile func

* Add compile func

* Add compile func

* Add is_dynamic option

* Add is_dynamic option

* Add is_dynamic option

* Add is_dynamic option

* rm infer log

* add cuda11.6 poros lib

* fixed bug

* fixed bug

* fixed multi outputs

* fixed multi outputs

* fixed multi outputs

* fixed multi outputs

* fixed multi outputs

* fixed multi outputs

* fixed multi outputs

* fixed multi outputs

* fixed multi outputs

* fixed multi outputs

* fixed multi outputs

* rm logs

* test

* test

* test

* add test log

* add test log

* add test log

* add test log

* support cpu

* support cpu

* support cpu

* support cpu

* support member variable definition

* rm useless log

* fixed name

* resolve conflict

* resolve conflict

* resolve conflict

* fixed cmake

* add GetInputInfos&GetOutputInfos

* add GetInputInfos&GetOutputInfos

* fixed bug

* fixed runtime.py

* add compile func

* add np

* deal with comments

* rm to_inter func

* add property
 2022-10-17 15:28:12 +08:00
DefTruth
e24c592f43 [osx] fixed mac osx arm64 and x86_64 0.3.0 rpath error (#374) 
* Update paddle_inference.cmake

* Update process_libraries.py.in

* Update process_libraries.py.in

* Update paddle_inference.cmake

* Update CMakeLists.txt

* Update VERSION_NUMBER

* Update VERSION_NUMBER

* Update download_prebuilt_libraries.md

* Update gpu.md

* Update cpu.md

* Update download_prebuilt_libraries.md

* Update jetson.md

* Update tensorrt_tricks.md

* Update cpp.md

Co-authored-by: Jason <jiangjiajun@baidu.com>
 2022-10-16 15:23:35 +08:00
TrellixVulnTeam
54b822caa3 adding numeric_owner as a keyword argument (#367) 
numeric_owner needs to be a keyword argument in Python 3.5+ according to the [docs](https://docs.python.org/3/library/tarfile.html)
 2022-10-14 09:20:29 +08:00
WJJ1995
b557dbc2d8 Add YOLOv5-cls Model (#335) 
* add yolov5cls

* fixed bugs

* fixed bugs

* fixed preprocess bug

* add yolov5cls readme

* deal with comments

* Add YOLOv5Cls Note

* add yolov5cls test

Co-authored-by: Jason <jiangjiajun@baidu.com>
 2022-10-12 15:57:26 +08:00
Jason
945e197bd1 Fix bug of get input/output information from PaddleBackend (#339) 
* Fix bug of get input/output information from PaddleBackend

* Support Paddle Inference with TensorRT (#340)

* Fix bug
 2022-10-12 11:37:26 +08:00
Zheng_Bicheng
9c3ac8f0da [vision] Add AdaFace model support (#301) 
* 新增adaface模型

* 新增adaface模型python代码

* 新增adaface模型example代码

* 删除无用的import

* update

* 修正faceid文档的错误

* 修正faceid文档的错误

* 删除无用文件

* 新增adaface模型paddleinference推理代码,模型文件先提交方便测试后期会删除

* 新增adaface模型paddleinference推理代码,模型文件先提交方便测试后期会删除

* 按照要求修改并跑通cpp example

* 测试python example

* python cpu测试通过，修改了文档

* 修正文档，替换了模型下载地址

* 修正文档

* 修正文档

Co-authored-by: DefTruth <31974251+DefTruth@users.noreply.github.com>
 2022-10-11 09:55:18 +08:00
yeliang2258
2a68a23baf Add paddle quantize model support for ORT, TRT and MKLDNN deploy backend (#257) 
* add quantize model support for trt and paddle

* fix bugs

* fix

* update paddle2onnx version

* update version

* add quantize test

Co-authored-by: Jason <jiangjiajun@baidu.com>
 2022-10-09 20:00:05 +08:00
Jason
5d4372955f Add some comments for python api (#327) 
* Add some comments for python api

* Update setup.py

* Update runtime.py
 2022-10-09 10:05:18 +08:00
heliqi
a3fa5989d2 Fix set_paddle_mkldnn python interface (#328) 
* fd serving add dockerfile

* fix enable_paddle_mkldnn

* delete disable_paddle_mkldnn

* fix python set_paddle_mkldnn

Co-authored-by: Jason <jiangjiajun@baidu.com>
 2022-10-08 16:49:40 +08:00
heliqi
d57e997fa0 Fd serving add docker images correlation and docs (#311) 
* fd serving add dockerfile

* fix enable_paddle_mkldnn

* delete disable_paddle_mkldnn

Co-authored-by: Jason <jiangjiajun@baidu.com>
 2022-10-08 16:08:07 +08:00
DefTruth
c4288a92e1 [lite] add more options for lite backend (#313) 
* [cmake] support Android arm64-v8a & armeabi-v7a native c++ sdk

* [cmake] fixed patchelf download on mac and android

* [lite] Add threads and power_mode option support

* [pybind] update runtime pybind for lite power mode

* [python] Add set_lite_power_mode api to runtime

* [Lite] add lite enable_fp16 option support

* [lite] add more options for lite backend.

* [cmake] fixed Paddle Lite typo

* [runtime] format LitePowerMode enum comments

* [runtime] format lite option comments
 2022-10-04 17:31:48 +08:00
TrellixVulnTeam
ad50d9c701 CVE-2007-4559 Patch (#315) 
Adding tarfile member sanitization to extractall()

Co-authored-by: TrellixVulnTeam <kasimir.schulz@trellix.com>
Co-authored-by: Jason <jiangjiajun@baidu.com>
Co-authored-by: Zeyu Chen <chenzeyu01@baidu.com>
 2022-10-02 18:24:21 +08:00
Jack Zhou
dd365fb721 Add trt max workspace setting (#308) 
* add trt max workspace setting

* fix set trt max workspace
 2022-09-30 09:54:34 +08:00
Jason
8ba4a26ebb Refine cpp/python api of visualize with lots of deprecated apis (#303) 
* fix patchelf

* refine visualize api

* Update CMakeLists.txt

* refine visualize api

* add libs directory

* Create __init__.py
 2022-09-29 14:06:45 +08:00
DefTruth
c5f85de356 [lite] Add threads and power_mode option support (#298) 
* [cmake] support Android arm64-v8a & armeabi-v7a native c++ sdk

* [cmake] fixed patchelf download on mac and android

* [lite] Add threads and power_mode option support

* [pybind] update runtime pybind for lite power mode

* [python] Add set_lite_power_mode api to runtime
 2022-09-28 18:09:35 +08:00
Jason
7af1fa0946 Fix patchelf problem (#295) 
fix patchelf
 2022-09-28 12:33:32 +08:00
Jason
1f35f2036e Decrease wheel package size (#287) 
* Decrease wheel package size

* Decrease wheel package size

* Decrease wheel package size
 2022-09-27 18:02:34 +08:00
heliqi
69be5b5232 fastdeploy support serving (#272) 
* fd support serving

* fd support serving optimize dir

* optimize code

Co-authored-by: Jason <jiangjiajun@baidu.com>
 2022-09-27 14:07:19 +08:00
Jason
36eb6fbba6 Fix build on jetson (#281) 
* Fix compile on Jetson

* trigger ci
 2022-09-26 19:23:30 +08:00
Jason
4421fc5a8f Merge branch 'develop' into add_openvino_mac 2022-09-26 11:32:15 +08:00
Jason
360bee46b5 Support build on jetson (#276) 
* support jetson build

* Update allocate.cc

* update setup

* Update CMakeLists.txt

* Update setup.py
 2022-09-23 13:11:11 +08:00
Jason
2d3e61582d Rename pybind/fastdeploy_runtime.cc to pybind/runtime.cc (#273) 
* fix yaml

* Rename pybind/fastdeploy_runtime.cc to runtime.cc
 2022-09-23 11:16:02 +08:00
huangjianhui
625845c7d6 Update ppseg with eigen functions (#238) 
* Update ppseg backend support type

* Update ppseg preprocess if condition

* Update README.md

* Update README.md

* Update README.md

* Update ppseg with eigen functions

* Delete old argmax function

* Update README.md

* Delete apply_softmax in ppseg example demo

* Update ppseg code with createFromTensor function

* Delete FDTensor2CVMat function

* Update README.md

* Update README.md

* Update README.md

* Update README.md

* Update ppseg model.cc with transpose&&softmax in place convert

* Update segmentation_result.md

* Update model.cc

* Update README.md

* Update README.md

Co-authored-by: Jason <jiangjiajun@baidu.com>
 2022-09-22 21:21:47 +08:00
zhoushunjie
50117fa6d2 Fix mac python lib link 2022-09-22 19:26:11 +08:00
Jason
e227c5625e Rename fastdeploy_runtime.h to runtime.h and Frontend to ModelFormat (#263) 
rename frontend to model_format
 2022-09-22 13:24:05 +08:00
zhoushunjie
df996ed849 Fix empty path when add dll dir in windows 2022-09-21 20:05:19 +08:00
zhoushunjie
f5ea967654 Fix rpath setting in linux 2022-09-21 20:05:19 +08:00
zhoushunjie
662b1e6113 add ORT_DIRECTORY compiler option 2022-09-21 20:05:19 +08:00
heliqi
a8e447f225 yolov5 servitization optimization (#262) 
* yolov5 split pre and post process

* yolov5 postprocess

* yolov5 postprocess
 2022-09-21 18:22:39 +08:00
Jack Zhou
e7f741292e Add some lib directories compiler option (#255) 
* Add OPENCV_DIRECTORY option to provide the ability to specify the installed opecv lib pat

* Use find_package for opencv in windows, mac and linux

* Fix opencv cmake

* Fix python lib rpath setting

* fix mac python package

* Add some promt when use different opencv lib

* add status message

* Fix the backslash

* Fix python package user defined libs

* Fix windows python process libs

* Add windows lib set path
 2022-09-21 13:25:56 +08:00
Jason
addce837bc Add paddlelite backend support (#260) 
* Add paddlelite backend support

* Update CMakeLists.txt

* Update __init__.py
 2022-09-21 13:22:34 +08:00
Jason
74f1143aba Support disable logging information (#254) 
* Support disable logging information

* Support disable logging information
 2022-09-20 15:44:10 +08:00
Jason
5046574b95 Fix bug for part of detection model (#243) 
* fix error for part of detection model

* fix error for part of detection model

* add patch paddle inference
 2022-09-16 16:31:34 +08:00
Jason
e9fb6141cf Update setup.py 2022-09-15 14:36:20 +08:00
Jack Zhou
14ba9ce6c2 Add uie python example and doc (#221) 
* add fastdeploy.text.UIEModel

* Add uie python example

* Add one schema for cpp demo

* Add ConvertUIEResultToDict for pretty the uie result in python

* remove default args for SchemaNode

* Add uie example args

* Add uie python api desc

* Add infer.py usage

* truncate some example output

* Add uie schema usage

* Add uie result md

* Add uie c++ api doc
 2022-09-15 06:06:40 +08:00
Jason
695034fdad Modify directory external and build_scripts name (#225) 
modify directory name
 2022-09-14 20:13:35 +08:00
Jason
68523be411 Modify file structure to separate python and cpp code (#223) 
Modify code structure
 2022-09-14 15:44:13 +08:00