apps/FastDeploy
1
0
Fork 0
mirror of https://github.com/PaddlePaddle/FastDeploy.git synced 2025-10-11 19:40:25 +08:00
Code Issues Actions 6 Packages Projects Releases Wiki Activity
1,237 Commits 16 Branches 8 Tags
d0fa2fcf5a94e530453d16f46fd8dbbdecb1bfbc
Commit Graph

79 Commits

Author SHA1 Message Date
DefTruth
256f7c2269 [Bug Fix] fixed ppdet postprocess empty result error (#691) 
* [Android] Add CxxBuffer to native PaddleSegModel

* [Android] Add PaddleSeg android app example

* [Android] Add SCRFD android app example

* [Doc] fix typos

* [Android] revert camera setting changes

* [Bug Fix] fixed ppdet postprocess empty result error
 2022-11-24 18:56:38 +08:00
yeliang2258
7206094ddd [Backend] Add ORT CPU and CUDA kernel for adaptive_pool OP (#609) 
* add ORT CPU and CUDA kernel for adaptive_pool

* update code

* update paddle2onnx version
 2022-11-24 10:39:29 +08:00
DefTruth
c4d43bdd9b [cmake] change -Os flag -> Ofast to boost performance on Android (#652) 
- change -Os flag -> Ofast to boost performance on Android
 2022-11-22 15:31:30 +08:00
Jason
2c90610020 Fix build error on Windows (#653) 2022-11-22 14:55:36 +08:00
jiangjiajun
46506761d5 Remove static libraries while building 2022-11-21 06:58:54 +00:00
Jack Zhou
eeae48deff [Other] faster_tokenizer->fast_tokenizer (#636) 
* faster_tokenizer->fast_tokenizer

* ErnieFasterTokenizer->ErnieFastTokenizer

* update the fastdeploy_init

Co-authored-by: Jason <jiangjiajun@baidu.com>
 2022-11-21 13:45:00 +08:00
DefTruth
6a368f3448 [Android] Support segmentation and facedet in Android (#567) 
* [FlyCV] Add global SetProcLibCpuNumThreads method

* [Android] Support segmentation and facedet in Android

* [Android] add JNI instance check to j_runtime_option_obj

* [Model] fixed ppseg flycv resize error

* [FlyCV] fix FlyCV resize flags

* [cmake] remove un-need lite compile option

* [Android] add PaddleSegModel JNI and fix some bugs

* [Android] bind PaddleSegModel via JNI

* [Android] bind VisSegmentation via JNI

* [Android] bind YOLOv5Face and SCRFD via JNI

* [Android] fix NewJavaFaceDetectionResultFromCxx error
 2022-11-13 17:47:50 +08:00
heliqi
6bad97351f [Other]Add dlpack (#556) 
add dlpack
 2022-11-10 16:00:08 +08:00
yeliang2258
fa807340be [Backend] Add Rockchip RV1126 deploy support through PaddleLite TIM-VX (#439) 
* add rk1126 support

* update lib

* fix compile bugs

* update doc

* fix complie bug

* update doc

* update doc

* update code

* support model bigger than 2G

* update code

* update code

* update code

* update doc

* update code

* fix bug

* update code

* update code

* update code

* update doc

* update info

* code style check

* update code

* update doc

Co-authored-by: Jason <jiangjiajun@baidu.com>
 2022-11-10 10:05:47 +08:00
czr-gc
762f6d9e48 [Bug Fix]: fix paddle2onnx dependency issue. (#522) 
fix(paddle_backend): fix paddle2onnx dependency issue.
 2022-11-08 15:02:10 +08:00
Jason
9fa612c24b [Backend] Enable TensorRT BatchedNMSDynamic_TRT plugin (#449) 
* Enable TensorRT EfficientNMS plugin

* remove some temporary code

* Update trt_backend.cc

* Update utils.h
 2022-11-04 11:46:29 +08:00
WJJ1995
9437dec9f5 [Model] add PFLD model (#433) 
* support face alignment PFLD

* add PFLD demo

* fixed FaceAlignmentResult

* fixed bugs

* fixed img size

* fixed readme

* deal with comments

* fixed readme

* add pfld testcase

* update infer.py

* add gflags for example

* update c++ readme

* add gflags in example

* fixed for ci

* fixed gflags.cmake

* deal with comments

* update infer demo

Co-authored-by: Jason <jiangjiajun@baidu.com>
 2022-11-02 11:50:16 +08:00
Wang Xinyu
e5c955dd3e [Model] yolo use external stream, avoid reallocating output tensors (#447) 
* yolov5 use external stream

* yolov5lite/v6/v7/v7e2etrt: optimize output tensor and cuda stream

* avoid reallocating output tensors

* add input output tensors to FastDeployModel

* add cuda.cmake

* rename to reused_input/output_tensors

* eliminate cmake cuda arch error

* use swap to release input and output tensors

Co-authored-by: Jason <jiangjiajun@baidu.com>
 2022-11-02 09:52:27 +08:00
Zheng_Bicheng
4ffcfbe726 [Backend] Add RKNPU2 backend support (#456) 
* 10-29/14:05
* 新增cmake
* 新增rknpu2 backend

* 10-29/14:43
* Runtime fd_type新增RKNPU代码

* 10-29/15:02
* 新增ppseg RKNPU2推理代码

* 10-29/15:46
* 新增ppseg RKNPU2 cpp example代码

* 10-29/15:51
* 新增README文档

* 10-29/15:51
* 按照要求修改部分注释以及变量名称

* 10-29/15:51
* 修复重命名之后，cc文件中的部分代码还用旧函数名的bug

* 10-29/22:32
* str(Device::NPU)将输出NPU而不是UNKOWN
* 修改runtime文件中的注释格式
* 新增Building Summary ENABLE_RKNPU2_BACKEND输出
* pybind新增支持rknpu2
* 新增python编译选项
* 新增PPSeg Python代码
* 新增以及更新各种文档

* 10-30/14:11
* 尝试修复编译cuda时产生的错误

* 10-30/19:27
* 修改CpuName和CoreMask层级
* 修改ppseg rknn推理层级
* 图片将移动到网络进行下载

* 10-30/19:39
* 更新文档

* 10-30/19:39
* 更新文档
* 更新ppseg rknpu2 example中的函数命名方式
* 更新ppseg rknpu2 example为一个cc文件
* 修复disable_normalize_and_permute部分的逻辑错误
* 移除rknpu2初始化时的无用参数

* 10-30/19:39
* 尝试重置python代码

* 10-30/10:16
* rknpu2_config.h文件不再包含rknn_api头文件防止出现导入错误的问题

* 10-31/14:31
* 修改pybind，支持最新的rknpu2 backends
* 再次支持ppseg python推理
* 移动cpuname 和 coremask的层级

* 10-31/15:35
* 尝试修复rknpu2导入错误

* 10-31/19:00
* 新增RKNPU2模型导出代码以及其对应的文档
* 更新大量文档错误

* 10-31/19:00
* 现在编译完fastdeploy仓库后无需重新设置RKNN2_TARGET_SOC

* 10-31/19:26
* 修改部分错误文档

* 10-31/19:26
* 修复错误删除的部分
* 修复各种错误文档
* 修复FastDeploy.cmake在设置RKNN2_TARGET_SOC错误时，提示错误的信息
* 修复rknpu2_backend.cc中存在的中文注释

* 10-31/20:45
* 删除无用的注释

* 10-31/20:45
* 按照要求修改Device::NPU为Device::RKNPU，硬件将共用valid_hardware_backends
* 删除无用注释以及debug代码

* 11-01/09:45
* 更新变量命名方式

* 11-01/10:16
* 修改部分文档，修改函数命名方式

Co-authored-by: Jason <jiangjiajun@baidu.com>
 2022-11-01 11:14:05 +08:00
Jason
bb00e0757e [Model] Integrate FlyCV image processing library (#375) 
* Add falcon cmake

* Update CMakeLists.txt

* Add implementation for more preprocessors

* Add more implementation

* Add more implementations by flycv

* Fix some name

* fix some bug

* ready to test

* add fuse

* fix fuse problem

* add debug code

* add debug

* [Android] integrate flycv to Android (#459)

* [Android] integrate flycv into Andorid

* Falconcv (#27)

* [Bug Fix ]Update ppseg visualize python api && demo (#454)

Update ppseg visualize python api && demo

* [Model] update pptracking letterboxresize and add some comment (#438)

* add override mark

* delete some

* recovery

* recovery

* add tracking

* add tracking py_bind and example

* add pptracking

* add pptracking

* iomanip head file

* add opencv_video lib

* add python libs package

Signed-off-by: ChaoII <849453582@qq.com>

* complete comments

Signed-off-by: ChaoII <849453582@qq.com>

* add jdeTracker_ member variable

Signed-off-by: ChaoII <849453582@qq.com>

* add 'FASTDEPLOY_DECL' macro

Signed-off-by: ChaoII <849453582@qq.com>

* remove kwargs params

Signed-off-by: ChaoII <849453582@qq.com>

* [Doc]update pptracking docs

* delete 'ENABLE_PADDLE_FRONTEND' switch

* add pptracking unit test

* update pptracking unit test

Signed-off-by: ChaoII <849453582@qq.com>

* modify test video file path and remove trt test

* update unit test model url

* remove 'FASTDEPLOY_DECL' macro

Signed-off-by: ChaoII <849453582@qq.com>

* fix build python packages about pptracking on win32

Signed-off-by: ChaoII <849453582@qq.com>

* update comment

Signed-off-by: ChaoII <849453582@qq.com>

* add pptracking model explain

Signed-off-by: ChaoII <849453582@qq.com>

Signed-off-by: ChaoII <849453582@qq.com>
Co-authored-by: Jason <jiangjiajun@baidu.com>

Signed-off-by: ChaoII <849453582@qq.com>
Co-authored-by: huangjianhui <852142024@qq.com>
Co-authored-by: ChaoII <849453582@qq.com>
Co-authored-by: Jason <jiangjiajun@baidu.com>

* [cmake] optimize examples CMakeLists.txt

Signed-off-by: ChaoII <849453582@qq.com>
Co-authored-by: huangjianhui <852142024@qq.com>
Co-authored-by: ChaoII <849453582@qq.com>
Co-authored-by: Jason <jiangjiajun@baidu.com>

* remove debug log

* remove function

* remove function

Signed-off-by: ChaoII <849453582@qq.com>
Co-authored-by: DefTruth <31974251+DefTruth@users.noreply.github.com>
Co-authored-by: huangjianhui <852142024@qq.com>
Co-authored-by: ChaoII <849453582@qq.com>
 2022-11-01 10:42:52 +08:00
czr-gc
ede59af857 [Backend] support ipu in paddle inference backend. (#437) 
* feat(ipu): add ipu support for paddle_infer backend.

* fix(): remove unused env.

* fix(ipu): simplify user API for IPU.

* fix(cmake): fix merge conflict error in CMakeList.

Co-authored-by: Jason <jiangjiajun@baidu.com>
 2022-10-30 18:59:59 +08:00
Wang Xinyu
caa369f64a [Backend] TRT cast GPU input from int64 to int32, output from int32 to int64, and Windows support building CUDA files (#426) 
* TRT cast int64 to int32

* windows cmake build cuda src

* fix windows cmake error when build cuda src

* add a notice in windows gpu build doc

* cmake add cuda std=11

* TRT cast output from int32 to int64

* nits

* trt get original input output dtype
 2022-10-28 13:38:06 +08:00
huangjianhui
b565c15bf7 [Model] Add tinypose single && pipeline model (#177) 
* Add tinypose model

* Add PPTinypose python API

* Fix picodet preprocess bug && Add Tinypose examples

* Update tinypose example code

* Update ppseg preprocess if condition

* Update ppseg backend support type

* Update permute.h

* Update README.md

* Update code with comments

* Move files dir

* Delete premute.cc

* Add single model pptinypose

* Delete pptinypose old code in ppdet

* Code format

* Add ppdet + pptinypose pipeline model

* Fix bug for posedetpipeline

* Change Frontend to ModelFormat

* Change Frontend to ModelFormat in __init__.py

* Add python posedetpipeline/

* Update pptinypose example dir name

* Update README.md

* Update README.md

* Update README.md

* Update README.md

* Create keypointdetection_result.md

* Create README.md

* Create README.md

* Create README.md

* Update README.md

* Update README.md

* Create README.md

* Fix det_keypoint_unite_infer.py bug

* Create README.md

* Update PP-Tinypose by comment

* Update by comment

* Add pipeline directory

* Add pptinypose dir

* Update pptinypose to align accuracy

* Addd warpAffine processor

* Update GetCpuMat to  GetOpenCVMat

* Add comment for pptinypose && pipline

* Update docs/main_page.md

* Add README.md for pptinypose

* Add README for det_keypoint_unite

* Remove ENABLE_PIPELINE option

* Remove ENABLE_PIPELINE option

* Change pptinypose default backend

* PP-TinyPose Pipeline support multi PP-Detection models

* Update pp-tinypose comment

* Update by comments

* Add single test example

Co-authored-by: Jason <jiangjiajun@baidu.com>
 2022-10-21 09:28:23 +08:00
Wang Xinyu
c8d6c8244e [Model] Yolov5/v5lite/v6/v7/v7end2end: CUDA preprocessing (#370) 
* add yolo cuda preprocessing

* cmake build cuda src

* yolov5 support cuda preprocessing

* yolov5 cuda preprocessing configurable

* yolov5 update get mat data api

* yolov5 check cuda preprocess args

* refactor cuda function name

* yolo cuda preprocess padding value configurable

* yolov5 release cuda memory

* cuda preprocess pybind api update

* move use_cuda_preprocessing option to yolov5 model

* yolov5lite cuda preprocessing

* yolov6 cuda preprocessing

* yolov7 cuda preprocessing

* yolov7_e2e cuda preprocessing

* remove cuda preprocessing in runtime option

* refine log and cmake variable name

* fix model runtime ptr type

Co-authored-by: Jason <jiangjiajun@baidu.com>
 2022-10-19 16:04:58 +08:00
WJJ1995
f5c94e5471 Support Poros Backend (#188) 
* Add poros backend

* Add torch lib

* Add python3 lib

* set c++ 14 for poros

* fixed bugs

* fixed grammer bugs

* fixed grammer bugs

* fixed code bugs

* fixed code bugs

* fixed CreatePorosValue bug

* Add AtType2String for Log

* fixed trt_option

* fixed poros.cmake path

* fixed grammer bug

* fixed grammer bug

* fixed ambiguous reference

* fixed ambiguous reference

* fixed reference error

* fixed include files

* rm ENABLE_TRT_BACKEND in poros

* update CMakeLists.txt

* fixed CMakeLists.txt

* Add libtorch.so in CMakeLists.txt

* Fixed CMakeLists.txt

* Fixed CMakeLists.txt

* Fixed copy bug

* Fixed copy bug

* Fixed copy bug

* Fixed Cmake

* Fixed Cmake

* debug

* debug

* debug

* debug

* debug

* debug

* debug utils

* debug utils

* copy to cpu

* rm log info

* test share mem

* test share mem

* test share mem

* test multi outputs

* test multi outputs

* test multi outputs

* test multi outputs

* test multi outputs

* test multi outputs

* test multi outputs

* time cost

* time cost

* fixed bug

* time collect

* mem copy

* mem copy

* rm time log

* rm share mem

* fixed multi inputs bug

* add set_input_dtypes func

* add SetInputDtypes

* fixed bug

* fixed bug

* fixed prewarm data order

* debug

* debug

* debug

* debug

* debug

* debug

* debug

* debug

* debug

* debug

* debug

* fixed bug

* Add compile func

* Add compile func

* Add compile func

* Add is_dynamic option

* Add is_dynamic option

* Add is_dynamic option

* Add is_dynamic option

* rm infer log

* add cuda11.6 poros lib

* fixed bug

* fixed bug

* fixed multi outputs

* fixed multi outputs

* fixed multi outputs

* fixed multi outputs

* fixed multi outputs

* fixed multi outputs

* fixed multi outputs

* fixed multi outputs

* fixed multi outputs

* fixed multi outputs

* fixed multi outputs

* rm logs

* test

* test

* test

* add test log

* add test log

* add test log

* add test log

* support cpu

* support cpu

* support cpu

* support cpu

* support member variable definition

* rm useless log

* fixed name

* resolve conflict

* resolve conflict

* resolve conflict

* fixed cmake

* add GetInputInfos&GetOutputInfos

* add GetInputInfos&GetOutputInfos

* fixed bug

* fixed runtime.py

* add compile func

* add np

* deal with comments

* rm to_inter func

* add property
 2022-10-17 15:28:12 +08:00
DefTruth
e24c592f43 [osx] fixed mac osx arm64 and x86_64 0.3.0 rpath error (#374) 
* Update paddle_inference.cmake

* Update process_libraries.py.in

* Update process_libraries.py.in

* Update paddle_inference.cmake

* Update CMakeLists.txt

* Update VERSION_NUMBER

* Update VERSION_NUMBER

* Update download_prebuilt_libraries.md

* Update gpu.md

* Update cpu.md

* Update download_prebuilt_libraries.md

* Update jetson.md

* Update tensorrt_tricks.md

* Update cpp.md

Co-authored-by: Jason <jiangjiajun@baidu.com>
 2022-10-16 15:23:35 +08:00
DefTruth
584ba3de68 [win] Add fastdeploy_init.bat and update docs (#320) 
* [cmake] support Android arm64-v8a & armeabi-v7a native c++ sdk

* [cmake] fixed patchelf download on mac and android

* [lite] Add threads and power_mode option support

* [pybind] update runtime pybind for lite power mode

* [python] Add set_lite_power_mode api to runtime

* [Lite] add lite enable_fp16 option support

* [lite] add more options for lite backend.

* [cmake] fixed Paddle Lite typo

* [runtime] format LitePowerMode enum comments

* [runtime] format lite option comments

* [win] Add fastdeploy_init.bat and update docs

* [win] Add fastdeploy_init.bat and update docs
 2022-10-06 15:57:18 +08:00
DefTruth
c4288a92e1 [lite] add more options for lite backend (#313) 
* [cmake] support Android arm64-v8a & armeabi-v7a native c++ sdk

* [cmake] fixed patchelf download on mac and android

* [lite] Add threads and power_mode option support

* [pybind] update runtime pybind for lite power mode

* [python] Add set_lite_power_mode api to runtime

* [Lite] add lite enable_fp16 option support

* [lite] add more options for lite backend.

* [cmake] fixed Paddle Lite typo

* [runtime] format LitePowerMode enum comments

* [runtime] format lite option comments
 2022-10-04 17:31:48 +08:00
Jason
8ba4a26ebb Refine cpp/python api of visualize with lots of deprecated apis (#303) 
* fix patchelf

* refine visualize api

* Update CMakeLists.txt

* refine visualize api

* add libs directory

* Create __init__.py
 2022-09-29 14:06:45 +08:00
Jason
7af1fa0946 Fix patchelf problem (#295) 
fix patchelf
 2022-09-28 12:33:32 +08:00
Jason
311a59c62d Add patchelf to solve the build problem on Linux without patchelf (#291) 
* add patchelf as tool

* Update CMakeLists.txt
 2022-09-28 10:48:49 +08:00
Jason
1f35f2036e Decrease wheel package size (#287) 
* Decrease wheel package size

* Decrease wheel package size

* Decrease wheel package size
 2022-09-27 18:02:34 +08:00
Jason
9d1d1fa2cc Fix TensorRT link ambiguous problem (#283) 
fix trt conflict error

Co-authored-by: root <root@bjyz-sys-gpu-kongming3.bjyz.baidu.com>
 2022-09-27 10:02:49 +08:00
Jack Zhou
b83cb993ac Simplify cmake and add openvino directory (#285) 
* simplify the opencv.cmake

* Add OPENVINO_DIRECTORY option

* Add openvino directory
 2022-09-27 10:02:34 +08:00
DefTruth
9e09a55abb [docs] update win build docs with cmake-gui+vs2019 (#280) 
* Delete redundant Chinese comments

* [docs] update win build docs with cmake-gui+vs2019

* [docs] update win build docs with cmake-gui+vs2019

* [examples] replace some cn comments with en

* [cmake] update FastDeploy.cmake.in

* [docs] update windows c++ sdk usage docs

* [cmake] update FastDeploy.cmake.in

* [docs] update windows sdk usage docs

Co-authored-by: Jason <jiangjiajun@baidu.com>
 2022-09-26 19:25:12 +08:00
Jack Zhou
355382ad63 Move eigen to third party (#282) 
* remove useless statement

* Add eigen to third_party dir

* remove reducdant lines
 2022-09-26 19:24:02 +08:00
Jason
36eb6fbba6 Fix build on jetson (#281) 
* Fix compile on Jetson

* trigger ci
 2022-09-26 19:23:30 +08:00
Jason
4421fc5a8f Merge branch 'develop' into add_openvino_mac 2022-09-26 11:32:15 +08:00
zhoushunjie
ad03e771dd Add remove_duplicate_libraries function 2022-09-26 11:24:57 +08:00
zhoushunjie
f142fcdf60 Add get_openvino_libs 2022-09-25 18:26:04 +08:00
Jason
360bee46b5 Support build on jetson (#276) 
* support jetson build

* Update allocate.cc

* update setup

* Update CMakeLists.txt

* Update setup.py
 2022-09-23 13:11:11 +08:00
Jason
5ad7f64a3a Fix compile problem while disable all the option (#270) 
fix yaml
 2022-09-22 20:22:25 +08:00
DefTruth
189646f08f [Android] support fastdeploy with armeabi-v7a and arm64-v8a (#268) 
* [Andorid] support fastdeploy with armeabi-v7a and arm64-v8a

* [Android] support fastdeploy with armeabi-v7a and arm64-v8a

* [cmake] fixed custom opencv_directory error for android
 2022-09-22 19:10:14 +08:00
zhoushunjie
177da78bb0 Add tbb and tbb malloc dependency for openvino 2022-09-22 18:30:18 +08:00
Jason
ecbd78ae58 Remove debug code (#266) 
* Rename Frontend to ModelFormat in documents

* Remove useless debug flag
 2022-09-22 15:18:50 +08:00
zhoushunjie
fac68d408b Adjust message status 2022-09-21 20:05:19 +08:00
zhoushunjie
662b1e6113 add ORT_DIRECTORY compiler option 2022-09-21 20:05:19 +08:00
Jack Zhou
e7f741292e Add some lib directories compiler option (#255) 
* Add OPENCV_DIRECTORY option to provide the ability to specify the installed opecv lib pat

* Use find_package for opencv in windows, mac and linux

* Fix opencv cmake

* Fix python lib rpath setting

* fix mac python package

* Add some promt when use different opencv lib

* add status message

* Fix the backslash

* Fix python package user defined libs

* Fix windows python process libs

* Add windows lib set path
 2022-09-21 13:25:56 +08:00
Jason
addce837bc Add paddlelite backend support (#260) 
* Add paddlelite backend support

* Update CMakeLists.txt

* Update __init__.py
 2022-09-21 13:22:34 +08:00
Jack Zhou
14ba9ce6c2 Add uie python example and doc (#221) 
* add fastdeploy.text.UIEModel

* Add uie python example

* Add one schema for cpp demo

* Add ConvertUIEResultToDict for pretty the uie result in python

* remove default args for SchemaNode

* Add uie example args

* Add uie python api desc

* Add infer.py usage

* truncate some example output

* Add uie schema usage

* Add uie result md

* Add uie c++ api doc
 2022-09-15 06:06:40 +08:00
Jason
695034fdad Modify directory external and build_scripts name (#225) 
modify directory name
 2022-09-14 20:13:35 +08:00
Jason
68523be411 Modify file structure to separate python and cpp code (#223) 
Modify code structure
 2022-09-14 15:44:13 +08:00
Jason
0dd9ecee65 Optimize ocr system code (#209) 
* Support PPYOLOE plus model

* Optimize ocr system code

* modify example code

* fix patchelf of openvino

* optimize demo code of ocr

* remove debug code

* update demo code of ocr

Co-authored-by: Jack Zhou <zhoushunjie@baidu.com>
 2022-09-14 09:46:03 +08:00
DefTruth
17630f5665 [cmake] package examples to c++ sdk (#183) 
* [cmake] package examples to c++ sdk

package examples to c++ sdk

* [cmake] package examples to c++ sdk

package examples to c++ sdk
 2022-09-03 11:45:20 +08:00
Jason
e85a4c4f5b Optimize compilation process (#164) 
* refine build scripts

* fix copy for trt

* fix library import

* fix lib import

* fix lib import

* Update CMakeLists.txt

* Update process_libraries.py

* polish cmake

Co-authored-by: dev5 <paddle_dev5@DESKTOP-O9GS2N7>
 2022-08-29 20:18:29 +08:00