Commit Graph

130 Commits

Author SHA1 Message Date
Jack Zhou
dccb737d8d [Backend] Add collect shape for pp-trt backend (#372)
* Add collect_shape attr

* add EnableTunedTensorRtDynamicShape

* Add collect shape python api

* Fix quant model not set trt dynamic shape

* Add shape info print

* Fix shape print

* Use CopyFromCpu instead of ShareExternalData

* Add ENABLE_TRT_BACKEND macro

* Add shared data with
2022-10-20 17:02:56 +08:00
yunyaoXYY
24317e1a14 [Doc] Rename PPOCRSystem to PPOCR and update comments. (#395)
* Imporve OCR Readme

* Improve OCR Readme

* Improve OCR Readme

* Improve OCR Readme

* Improve OCR Readme

* Add Initialize function to PP-OCR

* Add Initialize function to PP-OCR

* Add Initialize function to PP-OCR

* Make all the model links come from PaddleOCR

* Improve OCR readme

* Improve OCR readme

* Improve OCR readme

* Improve OCR readme

* Add Readme for vision results

* Add Readme for vision results

* Add Readme for vision results

* Add Readme for vision results

* Add Readme for vision results

* Add Readme for vision results

* Add Readme for vision results

* Add Readme for vision results

* Add Readme for vision results

* Add Readme for vision results

* Add check for label file in postprocess of Rec model

* Add check for label file in postprocess of Rec model

* Add check for label file in postprocess of Rec model

* Add check for label file in postprocess of Rec model

* Add check for label file in postprocess of Rec model

* Add check for label file in postprocess of Rec model

* Add comments to create API docs

* Improve OCR comments

* Rename OCR and add comments

* Make sure previous python example works

* Make sure previous python example works

Co-authored-by: Jason <jiangjiajun@baidu.com>
2022-10-19 17:21:48 +08:00
huangjianhui
85e1c647f6 [Doc] Add comments for PPSeg && PPClas (#396)
* Add comment for PPSeg && PPClas

* Update main_page.md
2022-10-19 16:54:39 +08:00
Wang Xinyu
c8d6c8244e [Model] Yolov5/v5lite/v6/v7/v7end2end: CUDA preprocessing (#370)
* add yolo cuda preprocessing

* cmake build cuda src

* yolov5 support cuda preprocessing

* yolov5 cuda preprocessing configurable

* yolov5 update get mat data api

* yolov5 check cuda preprocess args

* refactor cuda function name

* yolo cuda preprocess padding value configurable

* yolov5 release cuda memory

* cuda preprocess pybind api update

* move use_cuda_preprocessing option to yolov5 model

* yolov5lite cuda preprocessing

* yolov6 cuda preprocessing

* yolov7 cuda preprocessing

* yolov7_e2e cuda preprocessing

* remove cuda preprocessing in runtime option

* refine log and cmake variable name

* fix model runtime ptr type

Co-authored-by: Jason <jiangjiajun@baidu.com>
2022-10-19 16:04:58 +08:00
WJJ1995
f5c94e5471 Support Poros Backend (#188)
* Add poros backend

* Add torch lib

* Add python3 lib

* set c++ 14 for poros

* fixed bugs

* fixed grammer bugs

* fixed grammer bugs

* fixed code bugs

* fixed code bugs

* fixed CreatePorosValue bug

* Add AtType2String for Log

* fixed trt_option

* fixed poros.cmake path

* fixed grammer bug

* fixed grammer bug

* fixed ambiguous reference

* fixed ambiguous reference

* fixed reference error

* fixed include files

* rm ENABLE_TRT_BACKEND in poros

* update CMakeLists.txt

* fixed CMakeLists.txt

* Add libtorch.so in CMakeLists.txt

* Fixed CMakeLists.txt

* Fixed CMakeLists.txt

* Fixed copy bug

* Fixed copy bug

* Fixed copy bug

* Fixed Cmake

* Fixed Cmake

* debug

* debug

* debug

* debug

* debug

* debug

* debug utils

* debug utils

* copy to cpu

* rm log info

* test share mem

* test share mem

* test share mem

* test multi outputs

* test multi outputs

* test multi outputs

* test multi outputs

* test multi outputs

* test multi outputs

* test multi outputs

* time cost

* time cost

* fixed bug

* time collect

* mem copy

* mem copy

* rm time log

* rm share mem

* fixed multi inputs bug

* add set_input_dtypes func

* add SetInputDtypes

* fixed bug

* fixed bug

* fixed prewarm data order

* debug

* debug

* debug

* debug

* debug

* debug

* debug

* debug

* debug

* debug

* debug

* fixed bug

* Add compile func

* Add compile func

* Add compile func

* Add is_dynamic option

* Add is_dynamic option

* Add is_dynamic option

* Add is_dynamic option

* rm infer log

* add cuda11.6 poros lib

* fixed bug

* fixed bug

* fixed multi outputs

* fixed multi outputs

* fixed multi outputs

* fixed multi outputs

* fixed multi outputs

* fixed multi outputs

* fixed multi outputs

* fixed multi outputs

* fixed multi outputs

* fixed multi outputs

* fixed multi outputs

* rm logs

* test

* test

* test

* add test log

* add test log

* add test log

* add test log

* support cpu

* support cpu

* support cpu

* support cpu

* support member variable definition

* rm useless log

* fixed name

* resolve conflict

* resolve conflict

* resolve conflict

* fixed cmake

* add GetInputInfos&GetOutputInfos

* add GetInputInfos&GetOutputInfos

* fixed bug

* fixed runtime.py

* add compile func

* add np

* deal with comments

* rm to_inter func

* add property
2022-10-17 15:28:12 +08:00
TrellixVulnTeam
54b822caa3 adding numeric_owner as a keyword argument (#367)
numeric_owner needs to be a keyword argument in Python 3.5+ according to the [docs](https://docs.python.org/3/library/tarfile.html)
2022-10-14 09:20:29 +08:00
WJJ1995
b557dbc2d8 Add YOLOv5-cls Model (#335)
* add yolov5cls

* fixed bugs

* fixed bugs

* fixed preprocess bug

* add yolov5cls readme

* deal with comments

* Add YOLOv5Cls Note

* add yolov5cls test

Co-authored-by: Jason <jiangjiajun@baidu.com>
2022-10-12 15:57:26 +08:00
Jason
945e197bd1 Fix bug of get input/output information from PaddleBackend (#339)
* Fix bug of get input/output information from PaddleBackend

* Support Paddle Inference with TensorRT (#340)

* Fix bug
2022-10-12 11:37:26 +08:00
Zheng_Bicheng
9c3ac8f0da [vision] Add AdaFace model support (#301)
* 新增adaface模型

* 新增adaface模型python代码

* 新增adaface模型example代码

* 删除无用的import

* update

* 修正faceid文档的错误

* 修正faceid文档的错误

* 删除无用文件

* 新增adaface模型paddleinference推理代码,模型文件先提交方便测试后期会删除

* 新增adaface模型paddleinference推理代码,模型文件先提交方便测试后期会删除

* 按照要求修改并跑通cpp example

* 测试python example

* python cpu测试通过,修改了文档

* 修正文档,替换了模型下载地址

* 修正文档

* 修正文档

Co-authored-by: DefTruth <31974251+DefTruth@users.noreply.github.com>
2022-10-11 09:55:18 +08:00
yeliang2258
2a68a23baf Add paddle quantize model support for ORT, TRT and MKLDNN deploy backend (#257)
* add quantize model support for trt and paddle

* fix bugs

* fix

* update paddle2onnx version

* update version

* add quantize test

Co-authored-by: Jason <jiangjiajun@baidu.com>
2022-10-09 20:00:05 +08:00
Jason
5d4372955f Add some comments for python api (#327)
* Add some comments for python api

* Update setup.py

* Update runtime.py
2022-10-09 10:05:18 +08:00
heliqi
a3fa5989d2 Fix set_paddle_mkldnn python interface (#328)
* fd serving add dockerfile

* fix enable_paddle_mkldnn

* delete disable_paddle_mkldnn

* fix python set_paddle_mkldnn

Co-authored-by: Jason <jiangjiajun@baidu.com>
2022-10-08 16:49:40 +08:00
heliqi
d57e997fa0 Fd serving add docker images correlation and docs (#311)
* fd serving add dockerfile

* fix enable_paddle_mkldnn

* delete disable_paddle_mkldnn

Co-authored-by: Jason <jiangjiajun@baidu.com>
2022-10-08 16:08:07 +08:00
DefTruth
c4288a92e1 [lite] add more options for lite backend (#313)
* [cmake] support Android arm64-v8a & armeabi-v7a native c++ sdk

* [cmake] fixed patchelf download on mac and android

* [lite] Add threads and power_mode option support

* [pybind] update runtime pybind for lite power mode

* [python] Add set_lite_power_mode api to runtime

* [Lite] add lite enable_fp16 option support

* [lite] add more options for lite backend.

* [cmake] fixed Paddle Lite typo

* [runtime] format LitePowerMode enum comments

* [runtime] format lite option comments
2022-10-04 17:31:48 +08:00
TrellixVulnTeam
ad50d9c701 CVE-2007-4559 Patch (#315)
Adding tarfile member sanitization to extractall()

Co-authored-by: TrellixVulnTeam <kasimir.schulz@trellix.com>
Co-authored-by: Jason <jiangjiajun@baidu.com>
Co-authored-by: Zeyu Chen <chenzeyu01@baidu.com>
2022-10-02 18:24:21 +08:00
Jack Zhou
dd365fb721 Add trt max workspace setting (#308)
* add trt max workspace setting

* fix set trt max workspace
2022-09-30 09:54:34 +08:00
Jason
8ba4a26ebb Refine cpp/python api of visualize with lots of deprecated apis (#303)
* fix patchelf

* refine visualize api

* Update CMakeLists.txt

* refine visualize api

* add libs directory

* Create __init__.py
2022-09-29 14:06:45 +08:00
DefTruth
c5f85de356 [lite] Add threads and power_mode option support (#298)
* [cmake] support Android arm64-v8a & armeabi-v7a native c++ sdk

* [cmake] fixed patchelf download on mac and android

* [lite] Add threads and power_mode option support

* [pybind] update runtime pybind for lite power mode

* [python] Add set_lite_power_mode api to runtime
2022-09-28 18:09:35 +08:00
heliqi
69be5b5232 fastdeploy support serving (#272)
* fd support serving

* fd support serving optimize dir

* optimize code

Co-authored-by: Jason <jiangjiajun@baidu.com>
2022-09-27 14:07:19 +08:00
Jason
2d3e61582d Rename pybind/fastdeploy_runtime.cc to pybind/runtime.cc (#273)
* fix yaml

* Rename pybind/fastdeploy_runtime.cc to runtime.cc
2022-09-23 11:16:02 +08:00
huangjianhui
625845c7d6 Update ppseg with eigen functions (#238)
* Update ppseg backend support type

* Update ppseg preprocess if condition

* Update README.md

* Update README.md

* Update README.md

* Update ppseg with eigen functions

* Delete old argmax function

* Update README.md

* Delete apply_softmax in ppseg example demo

* Update ppseg code with createFromTensor function

* Delete FDTensor2CVMat function

* Update README.md

* Update README.md

* Update README.md

* Update README.md

* Update ppseg model.cc with transpose&&softmax in place convert

* Update segmentation_result.md

* Update model.cc

* Update README.md

* Update README.md

Co-authored-by: Jason <jiangjiajun@baidu.com>
2022-09-22 21:21:47 +08:00
Jason
e227c5625e Rename fastdeploy_runtime.h to runtime.h and Frontend to ModelFormat (#263)
rename frontend to model_format
2022-09-22 13:24:05 +08:00
zhoushunjie
df996ed849 Fix empty path when add dll dir in windows 2022-09-21 20:05:19 +08:00
zhoushunjie
662b1e6113 add ORT_DIRECTORY compiler option 2022-09-21 20:05:19 +08:00
heliqi
a8e447f225 yolov5 servitization optimization (#262)
* yolov5 split pre and post process

* yolov5 postprocess

* yolov5 postprocess
2022-09-21 18:22:39 +08:00
Jack Zhou
e7f741292e Add some lib directories compiler option (#255)
* Add OPENCV_DIRECTORY option to provide the ability to specify the installed opecv lib pat

* Use find_package for opencv in windows, mac and linux

* Fix opencv cmake

* Fix python lib rpath setting

* fix mac python package

* Add some promt when use different opencv lib

* add status message

* Fix the backslash

* Fix python package user defined libs

* Fix windows python process libs

* Add windows lib set path
2022-09-21 13:25:56 +08:00
Jason
addce837bc Add paddlelite backend support (#260)
* Add paddlelite backend support

* Update CMakeLists.txt

* Update __init__.py
2022-09-21 13:22:34 +08:00
Jason
74f1143aba Support disable logging information (#254)
* Support disable logging information

* Support disable logging information
2022-09-20 15:44:10 +08:00
Jack Zhou
14ba9ce6c2 Add uie python example and doc (#221)
* add fastdeploy.text.UIEModel

* Add uie python example

* Add one schema for cpp demo

* Add ConvertUIEResultToDict for pretty the uie result in python

* remove default args for SchemaNode

* Add uie example args

* Add uie python api desc

* Add infer.py usage

* truncate some example output

* Add uie schema usage

* Add uie result md

* Add uie c++ api doc
2022-09-15 06:06:40 +08:00
Jason
68523be411 Modify file structure to separate python and cpp code (#223)
Modify code structure
2022-09-14 15:44:13 +08:00