apps/FastDeploy
1
0
Fork 0
mirror of https://github.com/PaddlePaddle/FastDeploy.git synced 2025-12-24 13:28:13 +08:00
Code Issues Actions 2 Packages Projects Releases Wiki Activity
1,722 Commits 29 Branches 10 Tags
56e4e56abc3d8a11e3a8e1d8043d88c2d5bd7b83
Commit Graph

107 Commits

Author SHA1 Message Date
heliqi
1427d5d29a [Bug] Vision and text compile source file add .cu file on CMakeLists.txt (#1188) 
* vision and text CMake add .cu file

* recover .cu file

* recover .cu file

* vision and text CMake add .cu file

* vision and text CMake add .cu file

* vision and text CMake add .cu file

* Update yolo_preprocess.cu
 2023-01-31 11:39:12 +08:00
DefTruth
2613e9c5d0 [Android] support fastdeploy build with static deps(60Mb->29~31Mb) (#1176) 
* [Android] support fastdeploy build with static deps(70Mb->17~19Mb)

* [Android] support fastdeploy build with static deps(60Mb->29~30Mb)

* fixed ci

* fixed ci

* [staticlib] support fd android static lib

* [static] optimize bundle_static_library func

* [staticlib] add api_helpers.h -> staticlib headers

* [staticlib] add api_helpers.h -> staticlib headers

* [staticlib] add api_helpers.h -> staticlib headers

* [staticlib] Fixed Paddle Lite paddle_use_kernels.h to support fd armv7 static lib

* [staticlib] Add strip -> fd static lib target

* [staticlib] optimize bundle_static_library func

* [staticlib] add strip for fd static lib on  mac osx

* [staticlib] move api_helpers -> lite/option

* [staticlib] optimize bundle_static_library

* [staticlib] add Android limit
 2023-01-30 19:39:56 +08:00
Wang Xinyu
62e051e21d [CVCUDA] CMake integration, vison processor CV-CUDA integration, PaddleClas support CV-CUDA (#1074) 
* cvcuda resize

* cvcuda center crop

* cvcuda resize

* add a fdtensor in fdmat

* get cv mat and get tensor support gpu

* paddleclas cvcuda preprocessor

* fix compile err

* fix windows compile error

* rename reused to cached

* address comment

* remove debug code

* add comment

* add manager run

* use cuda and cuda used

* use cv cuda doc

* address comment

---------

Co-authored-by: Jason <jiangjiajun@baidu.com>
 2023-01-30 09:33:49 +08:00
Wang Xinyu
3e5c219ab3 [Other] Generate Debian package and RPM package (#1043) 
* cpack deb

* cpack prerm script

* optim postinst script

* generate rpm package

* add build fd package doc

* update build fd package doc
 2023-01-10 10:26:58 +08:00
Jason
df20b2a02b [Other] Remove useless macros (#1095) 
* Remove useless macros

* triger ci

* fix check error

* rename INTEGRATE_PADDLE2ONNX to ENABLE_PADDLE2ONNX
 2023-01-09 21:35:23 +08:00
Jason
054dfec43a [Other] Remove some build options (#1090) 
* remove some flags

* add gpu check in cmake
 2023-01-09 17:36:07 +08:00
Jason
4aa4ebd7c3 [Other] [Part2] Upgrade runtime module (#1080) 
[Other] Upgrade runtime module
 2023-01-09 13:22:51 +08:00
Jason
d7a65e5c70 [Other] Upgrade runtime module (#1068) 
* Upgrade runtime module

* Update option.h

* Fix build error

* Move enumerates

* little modification

* little modification

* little modification:

* Remove some useless flags
 2023-01-06 13:44:05 +08:00
Dantès
34bea7649d [Backend] add sophgo backend (#1015) 
* Add Sophgo Device

add sophgo backend in fastdeploy

add resnet50, yolov5s, liteseg examples.

* replace sophgo lib with download links; fix model.cc bug

* modify CodeStyle

* remove unuseful files;change the names of sophgo device and sophgo
backend

* sophgo support python and add python examples

* remove unuseful rows in cmake according pr

Co-authored-by: Zilong Xing <zilong.xing@sophgo.com>
 2023-01-04 15:49:17 +08:00
Thomas Young
ab49b41080 add encryption (#1002) 
* add encryption

* add doc

* add doc

* fix bug
 2023-01-03 15:57:03 +08:00
Jason
f038268c79 [Bug Fix] Fix build with Paddle Inference on Jetson (#1019) 
Fix build with Paddle Inference on Jetson
 2022-12-30 15:06:13 +08:00
Wang Xinyu
f23c6c03af [Other] Remove TRT static libs in package (#1011) 
* remove duplicated and useless libs

* use os system to run ldd

* remove filter libs by ldd
 2022-12-30 11:58:56 +08:00
yeliang2258
45865c8724 [Other] Change all XPU to KunlunXin (#973) 
* [FlyCV] Bump up FlyCV -> official release 1.0.0

* XPU to KunlunXin

* update

* update model link

* update doc

* update device

* update code

* useless code

Co-authored-by: DefTruth <qiustudent_r@163.com>
Co-authored-by: DefTruth <31974251+DefTruth@users.noreply.github.com>
 2022-12-27 10:02:02 +08:00
yunyaoXYY
d45382e3cc [Backend] Add Huawei Ascend NPU deploy using PaddleLite CANN. (#757) 
* Add Huawei Ascend NPU deploy through PaddleLite CANN

* Add NNAdapter interface for paddlelite

* Modify Huawei Ascend Cmake

* Update way for compiling Huawei Ascend NPU deployment

* remove UseLiteBackend in UseCANN

* Support compile python whlee

* Change names of nnadapter API

* Add nnadapter pybind and remove useless API

* Support Python deployment on Huawei Ascend NPU

* Add models suppor for ascend

* Add PPOCR rec reszie for ascend

* fix conflict for ascend

* Rename CANN to Ascend

* Rename CANN to Ascend

* Improve ascend

* fix ascend bug

* improve ascend docs

* improve ascend docs

* improve ascend docs

* Improve Ascend

* Improve Ascend

* Move ascend python demo

* Imporve ascend

* Improve ascend

* Improve ascend

* Improve ascend

* Improve ascend

* Imporve ascend

* Imporve ascend

* Improve ascend
 2022-12-26 10:18:34 +08:00
WJJ1995
c8db4b442a [Runtime] Add Poros Backend Runtime demo for c++/python (#915) 
* add onnx_ort_runtime demo

* rm in requirements

* support batch eval

* fixed MattingResults bug

* move assignment for DetectionResult

* integrated x2paddle

* add model convert readme

* update readme

* re-lint

* add processor api

* Add MattingResult Free

* change valid_cpu_backends order

* add ppocr benchmark

* mv bs from 64 to 32

* fixed quantize.md

* fixed quantize bugs

* Add Monitor for benchmark

* update mem monitor

* Set trt_max_batch_size default 1

* fixed ocr benchmark bug

* support yolov5 in serving

* Fixed yolov5 serving

* Fixed postprocess

* update yolov5 to 7.0

* add poros runtime demos

* update readme

* Support poros abi=1

* rm useless note

* deal with comments

Co-authored-by: Jason <jiangjiajun@baidu.com>
 2022-12-20 19:03:14 +08:00
Wang Xinyu
81eaeddbd0 [Streamer] Basic framework, YAML parser, ppyoloe demo and video decoder demo (#863) 
* support trt installed in sys dir

* streamer init

* link elements and run

* create source bin

* add config

* restruct dirs

* set property

* link elements

* integrate perf

* add bbox parser

* parse yaml to string, video decoder

* use try pull for decoder and nits

* streamer ppyoloe cpp

* update readme

* video decoder cpp dir

* add cn readme

* update readme

* cmake nits

* refactor perf measurement
 2022-12-19 10:14:17 +08:00
Jason
2d998223ac [Backend] Add KunlunXin XPU deploy support (#894) 
Revert "Revert "[Backend] Add KunlunXin XPU deploy support" (#893)"

This reverts commit 0990ab9b50.
 2022-12-16 11:22:30 +08:00
Jason
0990ab9b50 Revert "[Backend] Add KunlunXin XPU deploy support" (#893) 
Revert "[Backend] Add KunlunXin XPU deploy support (#747)"

This reverts commit 5be839b322.
 2022-12-15 21:17:59 +08:00
yeliang2258
5be839b322 [Backend] Add KunlunXin XPU deploy support (#747) 
* add xpu support

* fix docs

* update code

* update doc

* update code

* update yolov5

* update cmake

* add int64_t data support

* fix

* update download links

* add en doc

* update code

* update xpu options

* update doc

* update doc

* update doc

* update lib links

* update doc

* update code

* update lite xpu link

* update xpu lib

* update doc

* update en doc
 2022-12-15 21:17:14 +08:00
DefTruth
2e342a35ba [Bug Fix] Fix gflags download timeout (#878) 
* [Doc] Add docs_i18n

* [cmake] fix gflags timeout

* Delete README_Ру́сский_язы́к.md

* Delete README_한국어.md

* Create README_Ру́сский_язы́к.md

* Delete README_Ру́сский_язы́к.md

* Update CMakeLists.txt

Co-authored-by: Jason <928090362@qq.com>
 2022-12-14 16:43:02 +08:00
Jason
8b6bb1723e [Compile] Force GLIBCXX_USE_CXX11_ABI=1 (#799) 
* Force =1

* Update CMakeLists.txt

* Update FastDeploy.cmake.in
 2022-12-05 19:44:04 +08:00
DefTruth
65f270df29 [FastTokenizer] Support FastTokenizer on Android (#783) 
* [FastTokenizer] Support FastTokenizer on Android

* [OMP] Add OMP bind_proc(close) policy

* [Android] Add Lite support for UIE

* [Android] Add VIS_SEG_OMP_NUM_THREADS
 2022-12-05 14:12:54 +08:00
Jason
5a0eaa1980 [Compile] Fix compile on windows (#765) 
Fix compile on windows
 2022-12-01 11:23:15 +08:00
Jason
49061bfb1c [Compile] Fix compile with ninja (#761) 
Fix compile with ninja

Co-authored-by: PaddleCI <paddle_ci@example.com>
 2022-11-30 21:08:27 +08:00
DefTruth
2a7705d7e8 [Bug Fix] fix libomp.so not found error (#715) 
* [Android] Add VisSegmentation NEON support

* [ARM] change vqaddq_u8 -> vaddq_u8

* [ARM] change vqaddq_u8 -> vaddq_u8

* [Bug Fix] add FDASSERT

* update assert info

* add QuantizeBlendingWeight8

* Update QuantizeBlendingWeight8

* Update VisSegmentation

* [Visualize] add DefaultVisualizeType and EnableFastVisuzlie

* fix typos

* fix typo

* Update VisSegmentation

* [Android] Add omp parallel support for Android

* Add omp schedule(static)

* [Bug Fix] fix libomp.so not found error
 2022-11-28 13:32:28 +08:00
Hao Guan
d8d030b02f [osx] detect cross compiling architecture (#712) 2022-11-28 11:26:19 +08:00
DefTruth
60b430f7be [ARM] Add VisSegmentation NEON + OMP support (#710) 
* [Android] Add VisSegmentation NEON support

* [ARM] change vqaddq_u8 -> vaddq_u8

* [ARM] change vqaddq_u8 -> vaddq_u8

* [Bug Fix] add FDASSERT

* update assert info

* add QuantizeBlendingWeight8

* Update QuantizeBlendingWeight8

* Update VisSegmentation

* [Visualize] add DefaultVisualizeType and EnableFastVisuzlie

* fix typos

* fix typo

* Update VisSegmentation

* [Android] Add omp parallel support for Android

* Add omp schedule(static)
 2022-11-28 10:10:38 +08:00
yeliang2258
d14828cb18 [Backend] Add AdaptivePool2d for TensorRT plugin (#668) 
* add adaptivepool2d for tensorrt plugin

* update code

* update code

* update code to fix bug
 2022-11-25 17:36:59 +08:00
DefTruth
256f7c2269 [Bug Fix] fixed ppdet postprocess empty result error (#691) 
* [Android] Add CxxBuffer to native PaddleSegModel

* [Android] Add PaddleSeg android app example

* [Android] Add SCRFD android app example

* [Doc] fix typos

* [Android] revert camera setting changes

* [Bug Fix] fixed ppdet postprocess empty result error
 2022-11-24 18:56:38 +08:00
yeliang2258
7206094ddd [Backend] Add ORT CPU and CUDA kernel for adaptive_pool OP (#609) 
* add ORT CPU and CUDA kernel for adaptive_pool

* update code

* update paddle2onnx version
 2022-11-24 10:39:29 +08:00
DefTruth
c4d43bdd9b [cmake] change -Os flag -> Ofast to boost performance on Android (#652) 
- change -Os flag -> Ofast to boost performance on Android
 2022-11-22 15:31:30 +08:00
Jason
2c90610020 Fix build error on Windows (#653) 2022-11-22 14:55:36 +08:00
jiangjiajun
46506761d5 Remove static libraries while building 2022-11-21 06:58:54 +00:00
Jack Zhou
eeae48deff [Other] faster_tokenizer->fast_tokenizer (#636) 
* faster_tokenizer->fast_tokenizer

* ErnieFasterTokenizer->ErnieFastTokenizer

* update the fastdeploy_init

Co-authored-by: Jason <jiangjiajun@baidu.com>
 2022-11-21 13:45:00 +08:00
DefTruth
6a368f3448 [Android] Support segmentation and facedet in Android (#567) 
* [FlyCV] Add global SetProcLibCpuNumThreads method

* [Android] Support segmentation and facedet in Android

* [Android] add JNI instance check to j_runtime_option_obj

* [Model] fixed ppseg flycv resize error

* [FlyCV] fix FlyCV resize flags

* [cmake] remove un-need lite compile option

* [Android] add PaddleSegModel JNI and fix some bugs

* [Android] bind PaddleSegModel via JNI

* [Android] bind VisSegmentation via JNI

* [Android] bind YOLOv5Face and SCRFD via JNI

* [Android] fix NewJavaFaceDetectionResultFromCxx error
 2022-11-13 17:47:50 +08:00
heliqi
6bad97351f [Other]Add dlpack (#556) 
add dlpack
 2022-11-10 16:00:08 +08:00
yeliang2258
fa807340be [Backend] Add Rockchip RV1126 deploy support through PaddleLite TIM-VX (#439) 
* add rk1126 support

* update lib

* fix compile bugs

* update doc

* fix complie bug

* update doc

* update doc

* update code

* support model bigger than 2G

* update code

* update code

* update code

* update doc

* update code

* fix bug

* update code

* update code

* update code

* update doc

* update info

* code style check

* update code

* update doc

Co-authored-by: Jason <jiangjiajun@baidu.com>
 2022-11-10 10:05:47 +08:00
czr-gc
762f6d9e48 [Bug Fix]: fix paddle2onnx dependency issue. (#522) 
fix(paddle_backend): fix paddle2onnx dependency issue.
 2022-11-08 15:02:10 +08:00
Jason
9fa612c24b [Backend] Enable TensorRT BatchedNMSDynamic_TRT plugin (#449) 
* Enable TensorRT EfficientNMS plugin

* remove some temporary code

* Update trt_backend.cc

* Update utils.h
 2022-11-04 11:46:29 +08:00
WJJ1995
9437dec9f5 [Model] add PFLD model (#433) 
* support face alignment PFLD

* add PFLD demo

* fixed FaceAlignmentResult

* fixed bugs

* fixed img size

* fixed readme

* deal with comments

* fixed readme

* add pfld testcase

* update infer.py

* add gflags for example

* update c++ readme

* add gflags in example

* fixed for ci

* fixed gflags.cmake

* deal with comments

* update infer demo

Co-authored-by: Jason <jiangjiajun@baidu.com>
 2022-11-02 11:50:16 +08:00
Wang Xinyu
e5c955dd3e [Model] yolo use external stream, avoid reallocating output tensors (#447) 
* yolov5 use external stream

* yolov5lite/v6/v7/v7e2etrt: optimize output tensor and cuda stream

* avoid reallocating output tensors

* add input output tensors to FastDeployModel

* add cuda.cmake

* rename to reused_input/output_tensors

* eliminate cmake cuda arch error

* use swap to release input and output tensors

Co-authored-by: Jason <jiangjiajun@baidu.com>
 2022-11-02 09:52:27 +08:00
Zheng_Bicheng
4ffcfbe726 [Backend] Add RKNPU2 backend support (#456) 
* 10-29/14:05
* 新增cmake
* 新增rknpu2 backend

* 10-29/14:43
* Runtime fd_type新增RKNPU代码

* 10-29/15:02
* 新增ppseg RKNPU2推理代码

* 10-29/15:46
* 新增ppseg RKNPU2 cpp example代码

* 10-29/15:51
* 新增README文档

* 10-29/15:51
* 按照要求修改部分注释以及变量名称

* 10-29/15:51
* 修复重命名之后，cc文件中的部分代码还用旧函数名的bug

* 10-29/22:32
* str(Device::NPU)将输出NPU而不是UNKOWN
* 修改runtime文件中的注释格式
* 新增Building Summary ENABLE_RKNPU2_BACKEND输出
* pybind新增支持rknpu2
* 新增python编译选项
* 新增PPSeg Python代码
* 新增以及更新各种文档

* 10-30/14:11
* 尝试修复编译cuda时产生的错误

* 10-30/19:27
* 修改CpuName和CoreMask层级
* 修改ppseg rknn推理层级
* 图片将移动到网络进行下载

* 10-30/19:39
* 更新文档

* 10-30/19:39
* 更新文档
* 更新ppseg rknpu2 example中的函数命名方式
* 更新ppseg rknpu2 example为一个cc文件
* 修复disable_normalize_and_permute部分的逻辑错误
* 移除rknpu2初始化时的无用参数

* 10-30/19:39
* 尝试重置python代码

* 10-30/10:16
* rknpu2_config.h文件不再包含rknn_api头文件防止出现导入错误的问题

* 10-31/14:31
* 修改pybind，支持最新的rknpu2 backends
* 再次支持ppseg python推理
* 移动cpuname 和 coremask的层级

* 10-31/15:35
* 尝试修复rknpu2导入错误

* 10-31/19:00
* 新增RKNPU2模型导出代码以及其对应的文档
* 更新大量文档错误

* 10-31/19:00
* 现在编译完fastdeploy仓库后无需重新设置RKNN2_TARGET_SOC

* 10-31/19:26
* 修改部分错误文档

* 10-31/19:26
* 修复错误删除的部分
* 修复各种错误文档
* 修复FastDeploy.cmake在设置RKNN2_TARGET_SOC错误时，提示错误的信息
* 修复rknpu2_backend.cc中存在的中文注释

* 10-31/20:45
* 删除无用的注释

* 10-31/20:45
* 按照要求修改Device::NPU为Device::RKNPU，硬件将共用valid_hardware_backends
* 删除无用注释以及debug代码

* 11-01/09:45
* 更新变量命名方式

* 11-01/10:16
* 修改部分文档，修改函数命名方式

Co-authored-by: Jason <jiangjiajun@baidu.com>
 2022-11-01 11:14:05 +08:00
Jason
bb00e0757e [Model] Integrate FlyCV image processing library (#375) 
* Add falcon cmake

* Update CMakeLists.txt

* Add implementation for more preprocessors

* Add more implementation

* Add more implementations by flycv

* Fix some name

* fix some bug

* ready to test

* add fuse

* fix fuse problem

* add debug code

* add debug

* [Android] integrate flycv to Android (#459)

* [Android] integrate flycv into Andorid

* Falconcv (#27)

* [Bug Fix ]Update ppseg visualize python api && demo (#454)

Update ppseg visualize python api && demo

* [Model] update pptracking letterboxresize and add some comment (#438)

* add override mark

* delete some

* recovery

* recovery

* add tracking

* add tracking py_bind and example

* add pptracking

* add pptracking

* iomanip head file

* add opencv_video lib

* add python libs package

Signed-off-by: ChaoII <849453582@qq.com>

* complete comments

Signed-off-by: ChaoII <849453582@qq.com>

* add jdeTracker_ member variable

Signed-off-by: ChaoII <849453582@qq.com>

* add 'FASTDEPLOY_DECL' macro

Signed-off-by: ChaoII <849453582@qq.com>

* remove kwargs params

Signed-off-by: ChaoII <849453582@qq.com>

* [Doc]update pptracking docs

* delete 'ENABLE_PADDLE_FRONTEND' switch

* add pptracking unit test

* update pptracking unit test

Signed-off-by: ChaoII <849453582@qq.com>

* modify test video file path and remove trt test

* update unit test model url

* remove 'FASTDEPLOY_DECL' macro

Signed-off-by: ChaoII <849453582@qq.com>

* fix build python packages about pptracking on win32

Signed-off-by: ChaoII <849453582@qq.com>

* update comment

Signed-off-by: ChaoII <849453582@qq.com>

* add pptracking model explain

Signed-off-by: ChaoII <849453582@qq.com>

Signed-off-by: ChaoII <849453582@qq.com>
Co-authored-by: Jason <jiangjiajun@baidu.com>

Signed-off-by: ChaoII <849453582@qq.com>
Co-authored-by: huangjianhui <852142024@qq.com>
Co-authored-by: ChaoII <849453582@qq.com>
Co-authored-by: Jason <jiangjiajun@baidu.com>

* [cmake] optimize examples CMakeLists.txt

Signed-off-by: ChaoII <849453582@qq.com>
Co-authored-by: huangjianhui <852142024@qq.com>
Co-authored-by: ChaoII <849453582@qq.com>
Co-authored-by: Jason <jiangjiajun@baidu.com>

* remove debug log

* remove function

* remove function

Signed-off-by: ChaoII <849453582@qq.com>
Co-authored-by: DefTruth <31974251+DefTruth@users.noreply.github.com>
Co-authored-by: huangjianhui <852142024@qq.com>
Co-authored-by: ChaoII <849453582@qq.com>
 2022-11-01 10:42:52 +08:00
czr-gc
ede59af857 [Backend] support ipu in paddle inference backend. (#437) 
* feat(ipu): add ipu support for paddle_infer backend.

* fix(): remove unused env.

* fix(ipu): simplify user API for IPU.

* fix(cmake): fix merge conflict error in CMakeList.

Co-authored-by: Jason <jiangjiajun@baidu.com>
 2022-10-30 18:59:59 +08:00
Wang Xinyu
caa369f64a [Backend] TRT cast GPU input from int64 to int32, output from int32 to int64, and Windows support building CUDA files (#426) 
* TRT cast int64 to int32

* windows cmake build cuda src

* fix windows cmake error when build cuda src

* add a notice in windows gpu build doc

* cmake add cuda std=11

* TRT cast output from int32 to int64

* nits

* trt get original input output dtype
 2022-10-28 13:38:06 +08:00
huangjianhui
b565c15bf7 [Model] Add tinypose single && pipeline model (#177) 
* Add tinypose model

* Add PPTinypose python API

* Fix picodet preprocess bug && Add Tinypose examples

* Update tinypose example code

* Update ppseg preprocess if condition

* Update ppseg backend support type

* Update permute.h

* Update README.md

* Update code with comments

* Move files dir

* Delete premute.cc

* Add single model pptinypose

* Delete pptinypose old code in ppdet

* Code format

* Add ppdet + pptinypose pipeline model

* Fix bug for posedetpipeline

* Change Frontend to ModelFormat

* Change Frontend to ModelFormat in __init__.py

* Add python posedetpipeline/

* Update pptinypose example dir name

* Update README.md

* Update README.md

* Update README.md

* Update README.md

* Create keypointdetection_result.md

* Create README.md

* Create README.md

* Create README.md

* Update README.md

* Update README.md

* Create README.md

* Fix det_keypoint_unite_infer.py bug

* Create README.md

* Update PP-Tinypose by comment

* Update by comment

* Add pipeline directory

* Add pptinypose dir

* Update pptinypose to align accuracy

* Addd warpAffine processor

* Update GetCpuMat to  GetOpenCVMat

* Add comment for pptinypose && pipline

* Update docs/main_page.md

* Add README.md for pptinypose

* Add README for det_keypoint_unite

* Remove ENABLE_PIPELINE option

* Remove ENABLE_PIPELINE option

* Change pptinypose default backend

* PP-TinyPose Pipeline support multi PP-Detection models

* Update pp-tinypose comment

* Update by comments

* Add single test example

Co-authored-by: Jason <jiangjiajun@baidu.com>
 2022-10-21 09:28:23 +08:00
Wang Xinyu
c8d6c8244e [Model] Yolov5/v5lite/v6/v7/v7end2end: CUDA preprocessing (#370) 
* add yolo cuda preprocessing

* cmake build cuda src

* yolov5 support cuda preprocessing

* yolov5 cuda preprocessing configurable

* yolov5 update get mat data api

* yolov5 check cuda preprocess args

* refactor cuda function name

* yolo cuda preprocess padding value configurable

* yolov5 release cuda memory

* cuda preprocess pybind api update

* move use_cuda_preprocessing option to yolov5 model

* yolov5lite cuda preprocessing

* yolov6 cuda preprocessing

* yolov7 cuda preprocessing

* yolov7_e2e cuda preprocessing

* remove cuda preprocessing in runtime option

* refine log and cmake variable name

* fix model runtime ptr type

Co-authored-by: Jason <jiangjiajun@baidu.com>
 2022-10-19 16:04:58 +08:00
WJJ1995
f5c94e5471 Support Poros Backend (#188) 
* Add poros backend

* Add torch lib

* Add python3 lib

* set c++ 14 for poros

* fixed bugs

* fixed grammer bugs

* fixed grammer bugs

* fixed code bugs

* fixed code bugs

* fixed CreatePorosValue bug

* Add AtType2String for Log

* fixed trt_option

* fixed poros.cmake path

* fixed grammer bug

* fixed grammer bug

* fixed ambiguous reference

* fixed ambiguous reference

* fixed reference error

* fixed include files

* rm ENABLE_TRT_BACKEND in poros

* update CMakeLists.txt

* fixed CMakeLists.txt

* Add libtorch.so in CMakeLists.txt

* Fixed CMakeLists.txt

* Fixed CMakeLists.txt

* Fixed copy bug

* Fixed copy bug

* Fixed copy bug

* Fixed Cmake

* Fixed Cmake

* debug

* debug

* debug

* debug

* debug

* debug

* debug utils

* debug utils

* copy to cpu

* rm log info

* test share mem

* test share mem

* test share mem

* test multi outputs

* test multi outputs

* test multi outputs

* test multi outputs

* test multi outputs

* test multi outputs

* test multi outputs

* time cost

* time cost

* fixed bug

* time collect

* mem copy

* mem copy

* rm time log

* rm share mem

* fixed multi inputs bug

* add set_input_dtypes func

* add SetInputDtypes

* fixed bug

* fixed bug

* fixed prewarm data order

* debug

* debug

* debug

* debug

* debug

* debug

* debug

* debug

* debug

* debug

* debug

* fixed bug

* Add compile func

* Add compile func

* Add compile func

* Add is_dynamic option

* Add is_dynamic option

* Add is_dynamic option

* Add is_dynamic option

* rm infer log

* add cuda11.6 poros lib

* fixed bug

* fixed bug

* fixed multi outputs

* fixed multi outputs

* fixed multi outputs

* fixed multi outputs

* fixed multi outputs

* fixed multi outputs

* fixed multi outputs

* fixed multi outputs

* fixed multi outputs

* fixed multi outputs

* fixed multi outputs

* rm logs

* test

* test

* test

* add test log

* add test log

* add test log

* add test log

* support cpu

* support cpu

* support cpu

* support cpu

* support member variable definition

* rm useless log

* fixed name

* resolve conflict

* resolve conflict

* resolve conflict

* fixed cmake

* add GetInputInfos&GetOutputInfos

* add GetInputInfos&GetOutputInfos

* fixed bug

* fixed runtime.py

* add compile func

* add np

* deal with comments

* rm to_inter func

* add property
 2022-10-17 15:28:12 +08:00
DefTruth
e24c592f43 [osx] fixed mac osx arm64 and x86_64 0.3.0 rpath error (#374) 
* Update paddle_inference.cmake

* Update process_libraries.py.in

* Update process_libraries.py.in

* Update paddle_inference.cmake

* Update CMakeLists.txt

* Update VERSION_NUMBER

* Update VERSION_NUMBER

* Update download_prebuilt_libraries.md

* Update gpu.md

* Update cpu.md

* Update download_prebuilt_libraries.md

* Update jetson.md

* Update tensorrt_tricks.md

* Update cpp.md

Co-authored-by: Jason <jiangjiajun@baidu.com>
 2022-10-16 15:23:35 +08:00
DefTruth
584ba3de68 [win] Add fastdeploy_init.bat and update docs (#320) 
* [cmake] support Android arm64-v8a & armeabi-v7a native c++ sdk

* [cmake] fixed patchelf download on mac and android

* [lite] Add threads and power_mode option support

* [pybind] update runtime pybind for lite power mode

* [python] Add set_lite_power_mode api to runtime

* [Lite] add lite enable_fp16 option support

* [lite] add more options for lite backend.

* [cmake] fixed Paddle Lite typo

* [runtime] format LitePowerMode enum comments

* [runtime] format lite option comments

* [win] Add fastdeploy_init.bat and update docs

* [win] Add fastdeploy_init.bat and update docs
 2022-10-06 15:57:18 +08:00