apps/FastDeploy
1
0
Fork 0
mirror of https://github.com/PaddlePaddle/FastDeploy.git synced 2025-12-24 13:28:13 +08:00
Code Issues Actions 2 Packages Projects Releases Wiki Activity
1,505 Commits 29 Branches 10 Tags
cbfc4eb246c571206861cd4acb7645ab69de4e84
Commit Graph

90 Commits

Author SHA1 Message Date
DefTruth
64e744dcf4 [FlyCV] enable flycv -> linux x64 (#939) 2022-12-22 10:13:10 +08:00
yeliang2258
1e9872db94 [Other] Add FlyCV support for A311D (#928) 
* add FlyCV support

* update doc

* update cmake

* re-ci

* fix bug

* fix cmake

* fix doc

* update doc

* fix doc
 2022-12-21 20:00:43 +08:00
DefTruth
725fe52df3 [FlyCV] Bump up FlyCV -> official release 1.0.0 (#916) 2022-12-21 10:36:07 +08:00
WJJ1995
5e350655f0 [Benchmark] Support paddle_trt for ppseg benchmark (#927) 
* add onnx_ort_runtime demo

* rm in requirements

* support batch eval

* fixed MattingResults bug

* move assignment for DetectionResult

* integrated x2paddle

* add model convert readme

* update readme

* re-lint

* add processor api

* Add MattingResult Free

* change valid_cpu_backends order

* add ppocr benchmark

* mv bs from 64 to 32

* fixed quantize.md

* fixed quantize bugs

* Add Monitor for benchmark

* update mem monitor

* Set trt_max_batch_size default 1

* fixed ocr benchmark bug

* support yolov5 in serving

* Fixed yolov5 serving

* Fixed postprocess

* update yolov5 to 7.0

* add poros runtime demos

* update readme

* Support poros abi=1

* rm useless note

* deal with comments

* support pp_trt for ppseg

* fixed symlink problem

Co-authored-by: Jason <jiangjiajun@baidu.com>
 2022-12-21 10:12:54 +08:00
WJJ1995
c8db4b442a [Runtime] Add Poros Backend Runtime demo for c++/python (#915) 
* add onnx_ort_runtime demo

* rm in requirements

* support batch eval

* fixed MattingResults bug

* move assignment for DetectionResult

* integrated x2paddle

* add model convert readme

* update readme

* re-lint

* add processor api

* Add MattingResult Free

* change valid_cpu_backends order

* add ppocr benchmark

* mv bs from 64 to 32

* fixed quantize.md

* fixed quantize bugs

* Add Monitor for benchmark

* update mem monitor

* Set trt_max_batch_size default 1

* fixed ocr benchmark bug

* support yolov5 in serving

* Fixed yolov5 serving

* Fixed postprocess

* update yolov5 to 7.0

* add poros runtime demos

* update readme

* Support poros abi=1

* rm useless note

* deal with comments

Co-authored-by: Jason <jiangjiajun@baidu.com>
 2022-12-20 19:03:14 +08:00
Jason
2d998223ac [Backend] Add KunlunXin XPU deploy support (#894) 
Revert "Revert "[Backend] Add KunlunXin XPU deploy support" (#893)"

This reverts commit 0990ab9b50.
 2022-12-16 11:22:30 +08:00
Jason
0990ab9b50 Revert "[Backend] Add KunlunXin XPU deploy support" (#893) 
Revert "[Backend] Add KunlunXin XPU deploy support (#747)"

This reverts commit 5be839b322.
 2022-12-15 21:17:59 +08:00
yeliang2258
5be839b322 [Backend] Add KunlunXin XPU deploy support (#747) 
* add xpu support

* fix docs

* update code

* update doc

* update code

* update yolov5

* update cmake

* add int64_t data support

* fix

* update download links

* add en doc

* update code

* update xpu options

* update doc

* update doc

* update doc

* update lib links

* update doc

* update code

* update lite xpu link

* update xpu lib

* update doc

* update en doc
 2022-12-15 21:17:14 +08:00
DefTruth
2e342a35ba [Bug Fix] Fix gflags download timeout (#878) 
* [Doc] Add docs_i18n

* [cmake] fix gflags timeout

* Delete README_Ру́сский_язы́к.md

* Delete README_한국어.md

* Create README_Ру́сский_язы́к.md

* Delete README_Ру́сский_язы́к.md

* Update CMakeLists.txt

Co-authored-by: Jason <928090362@qq.com>
 2022-12-14 16:43:02 +08:00
yeliang2258
6a1a3d001f [Backend] A311D support (#825) 
* add A311D support

* update code

* update toolchain

* update opencv_armhf lib

* update libs

* update code

* add install script

* update bos link

* update toolchain
 2022-12-13 11:53:36 +08:00
Jason
534d5b8c8b [Turorials] Add tutorials for intel gpu (#860) 
* Add tutorials for intel gpu

* fix gflags dependency

* Update README_CN.md

* Update README.md

* Update README.md
 2022-12-13 10:21:56 +08:00
DefTruth
24327044e9 [cmake] Update paddlelite.cmake (#845) 
Update paddlelite.cmake
 2022-12-09 17:40:57 +08:00
DefTruth
195132a1c7 [Android] Update Android build scripts & app download tasks (#835) 
* [Android] Add ERNIE3.0 intent and slot task jni support

* [Bug Fix] fix app sdk download tasks

* [Bug Fix] fix app sdk download tasks

* [JNI] remove empty .cc files

* [Android] Update Android build scripts
 2022-12-09 15:53:26 +08:00
Jason
b0988bf423 [Compile] Support custom paddle inference (#839) 
* Support custom paddle inference

* update setup.py
 2022-12-09 11:41:19 +08:00
Jack Zhou
647d6117f5 [Backend] Return paddle inference back to dev3 version (#824) 
back_to_dev3
 2022-12-07 21:18:20 +08:00
Thomas Young
5df62485c3 [Bug Fix] add ocr new feature and fix codestyle (#764) 
* fix ocr bug and add new feature

* fix bug

* fix bug

* fix bug

* fix bug

* fix bug

* fix bug

* add property

* add test

* fix code style

* fix bug

* fix bug

* fix bug

* fix port

* fix ocr

* fix_ocr

* fix ocr

* fix ocr

* fix ocr

* fix ocr

* Update paddle2onnx.cmake

* Update paddle2onnx.cmake

* Update paddle2onnx.cmake

Co-authored-by: Jason <jiangjiajun@baidu.com>
Co-authored-by: Jason <928090362@qq.com>
 2022-12-07 19:31:54 +08:00
Jack Zhou
d0ee21a16c Merge pull request #801 from joey12300/update_paddle_version 
[Backend]Update paddle inference version
 2022-12-05 21:09:18 +08:00
yeliang2258
655145f1c5 [Backend]update p2o version to 1.0.4 (#800) 
update p2o version to 1.0.4
 2022-12-05 19:45:19 +08:00
zhoushunjie
d3bf594493 Update paddle inference version 2022-12-05 10:49:54 +00:00
yeliang2258
104d965b38 [Backend] Add YOLOv5、PPYOLOE and PP-Liteseg for RV1126 (#647) 
* add yolov5 and ppyoloe for rk1126

* update code, rename rk1126 to rv1126

* add PP-Liteseg

* update lite lib

* updade doc for PPYOLOE

* update doc

* fix docs

* fix doc and examples

* update code

* uodate doc

* update doc

Co-authored-by: Jason <jiangjiajun@baidu.com>
 2022-12-05 16:48:00 +08:00
DefTruth
65f270df29 [FastTokenizer] Support FastTokenizer on Android (#783) 
* [FastTokenizer] Support FastTokenizer on Android

* [OMP] Add OMP bind_proc(close) policy

* [Android] Add Lite support for UIE

* [Android] Add VIS_SEG_OMP_NUM_THREADS
 2022-12-05 14:12:54 +08:00
Hao Guan
d8d030b02f [osx] detect cross compiling architecture (#712) 2022-11-28 11:26:19 +08:00
DefTruth
e53838c475 [Bug Fix] add enableCamera method to fix app crash (#696) 
* [Android] Add CxxBuffer to native PaddleSegModel

* [Android] Add PaddleSeg android app example

* [Android] Add SCRFD android app example

* [Doc] fix typos

* [Android] revert camera setting changes

* [Bug Fix] fixed ppdet postprocess empty result error

* [Android] add enableCamera method to fix app crash
 2022-11-25 09:01:35 +08:00
yeliang2258
7206094ddd [Backend] Add ORT CPU and CUDA kernel for adaptive_pool OP (#609) 
* add ORT CPU and CUDA kernel for adaptive_pool

* update code

* update paddle2onnx version
 2022-11-24 10:39:29 +08:00
Jack Zhou
eeae48deff [Other] faster_tokenizer->fast_tokenizer (#636) 
* faster_tokenizer->fast_tokenizer

* ErnieFasterTokenizer->ErnieFastTokenizer

* update the fastdeploy_init

Co-authored-by: Jason <jiangjiajun@baidu.com>
 2022-11-21 13:45:00 +08:00
DefTruth
ac805c26d9 [Bug Fix] fix FastDeploy.cmake.in errors for Android (#616) 
* [Backend] fix lite backend save model error

* [Backend] fixed typos

* [FlyCV] optimize the integration of FlyCV

* [cmake] close some tests options

* [cmake] close some test option

* [FlyCV] remove un-need warnings

* [FlyCV] remove un-need GetMat method

* [FlyCV] optimize FlyCV codes

* [cmake] remove un-need cmake function in examples/CMakelists

* [cmake] support gflags for Android

* [Android] Run button shutter in sub Ui Thread

* [Android] Update CameraSurfaceView

* [Android] Update Android SDK usage docs

* [Android] Add facedet Android app example

* [cmake] fix FastDeploy.cmake.in errors for Android

* [Doc] update SetProcLibCpuNumThreads API doc
 2022-11-16 22:33:04 +08:00
DefTruth
6a368f3448 [Android] Support segmentation and facedet in Android (#567) 
* [FlyCV] Add global SetProcLibCpuNumThreads method

* [Android] Support segmentation and facedet in Android

* [Android] add JNI instance check to j_runtime_option_obj

* [Model] fixed ppseg flycv resize error

* [FlyCV] fix FlyCV resize flags

* [cmake] remove un-need lite compile option

* [Android] add PaddleSegModel JNI and fix some bugs

* [Android] bind PaddleSegModel via JNI

* [Android] bind VisSegmentation via JNI

* [Android] bind YOLOv5Face and SCRFD via JNI

* [Android] fix NewJavaFaceDetectionResultFromCxx error
 2022-11-13 17:47:50 +08:00
yeliang2258
f74974c4a5 [Backend] Update p2o version to 1.0.3 (#570) 
update p2o version to 1.0.3
 2022-11-12 09:38:23 +08:00
yeliang2258
fa807340be [Backend] Add Rockchip RV1126 deploy support through PaddleLite TIM-VX (#439) 
* add rk1126 support

* update lib

* fix compile bugs

* update doc

* fix complie bug

* update doc

* update doc

* update code

* support model bigger than 2G

* update code

* update code

* update code

* update doc

* update code

* fix bug

* update code

* update code

* update code

* update doc

* update info

* code style check

* update code

* update doc

Co-authored-by: Jason <jiangjiajun@baidu.com>
 2022-11-10 10:05:47 +08:00
Jason
30412cb599 Update paddle2onnx.cmake 2022-11-09 15:32:48 +08:00
yeliang2258
8d31fe59e8 [Backend] Support the deployment of models which is larger than 2G in ORT and TRT backend (#514) 
* support model bigger than 2G

* update code

* update code

* fix bug

* update code
 2022-11-09 11:14:15 +08:00
DefTruth
295af8f467 [FlyCV] update vision processors with latest FlyCV API (#503) 
* [Other] Add static create methods to Mat

* [Other] avoid field name conflicts

* [FlyCV] update vision processors with latest FlyCV API

* [FlyCV] update vision processors with latest FlyCV API

* [Model] update rvm cv::Mat usage to FD Mat usage
 2022-11-06 13:29:46 +08:00
Jason
9fa612c24b [Backend] Enable TensorRT BatchedNMSDynamic_TRT plugin (#449) 
* Enable TensorRT EfficientNMS plugin

* remove some temporary code

* Update trt_backend.cc

* Update utils.h
 2022-11-04 11:46:29 +08:00
DefTruth
a36d49a973 [FlyCV] optimize the integration of FlyCV (#492) 
* [Backend] fix lite backend save model error

* [Backend] fixed typos

* [FlyCV] optimize the integration of FlyCV

* [cmake] close some tests options

* [cmake] close some test option

* [FlyCV] remove un-need warnings

* [FlyCV] remove un-need GetMat method

* [FlyCV] optimize FlyCV codes

* [cmake] remove un-need cmake function in examples/CMakelists

* [cmake] support gflags for Android
 2022-11-04 09:19:03 +08:00
WJJ1995
9437dec9f5 [Model] add PFLD model (#433) 
* support face alignment PFLD

* add PFLD demo

* fixed FaceAlignmentResult

* fixed bugs

* fixed img size

* fixed readme

* deal with comments

* fixed readme

* add pfld testcase

* update infer.py

* add gflags for example

* update c++ readme

* add gflags in example

* fixed for ci

* fixed gflags.cmake

* deal with comments

* update infer demo

Co-authored-by: Jason <jiangjiajun@baidu.com>
 2022-11-02 11:50:16 +08:00
Wang Xinyu
e5c955dd3e [Model] yolo use external stream, avoid reallocating output tensors (#447) 
* yolov5 use external stream

* yolov5lite/v6/v7/v7e2etrt: optimize output tensor and cuda stream

* avoid reallocating output tensors

* add input output tensors to FastDeployModel

* add cuda.cmake

* rename to reused_input/output_tensors

* eliminate cmake cuda arch error

* use swap to release input and output tensors

Co-authored-by: Jason <jiangjiajun@baidu.com>
 2022-11-02 09:52:27 +08:00
Zheng_Bicheng
4ffcfbe726 [Backend] Add RKNPU2 backend support (#456) 
* 10-29/14:05
* 新增cmake
* 新增rknpu2 backend

* 10-29/14:43
* Runtime fd_type新增RKNPU代码

* 10-29/15:02
* 新增ppseg RKNPU2推理代码

* 10-29/15:46
* 新增ppseg RKNPU2 cpp example代码

* 10-29/15:51
* 新增README文档

* 10-29/15:51
* 按照要求修改部分注释以及变量名称

* 10-29/15:51
* 修复重命名之后，cc文件中的部分代码还用旧函数名的bug

* 10-29/22:32
* str(Device::NPU)将输出NPU而不是UNKOWN
* 修改runtime文件中的注释格式
* 新增Building Summary ENABLE_RKNPU2_BACKEND输出
* pybind新增支持rknpu2
* 新增python编译选项
* 新增PPSeg Python代码
* 新增以及更新各种文档

* 10-30/14:11
* 尝试修复编译cuda时产生的错误

* 10-30/19:27
* 修改CpuName和CoreMask层级
* 修改ppseg rknn推理层级
* 图片将移动到网络进行下载

* 10-30/19:39
* 更新文档

* 10-30/19:39
* 更新文档
* 更新ppseg rknpu2 example中的函数命名方式
* 更新ppseg rknpu2 example为一个cc文件
* 修复disable_normalize_and_permute部分的逻辑错误
* 移除rknpu2初始化时的无用参数

* 10-30/19:39
* 尝试重置python代码

* 10-30/10:16
* rknpu2_config.h文件不再包含rknn_api头文件防止出现导入错误的问题

* 10-31/14:31
* 修改pybind，支持最新的rknpu2 backends
* 再次支持ppseg python推理
* 移动cpuname 和 coremask的层级

* 10-31/15:35
* 尝试修复rknpu2导入错误

* 10-31/19:00
* 新增RKNPU2模型导出代码以及其对应的文档
* 更新大量文档错误

* 10-31/19:00
* 现在编译完fastdeploy仓库后无需重新设置RKNN2_TARGET_SOC

* 10-31/19:26
* 修改部分错误文档

* 10-31/19:26
* 修复错误删除的部分
* 修复各种错误文档
* 修复FastDeploy.cmake在设置RKNN2_TARGET_SOC错误时，提示错误的信息
* 修复rknpu2_backend.cc中存在的中文注释

* 10-31/20:45
* 删除无用的注释

* 10-31/20:45
* 按照要求修改Device::NPU为Device::RKNPU，硬件将共用valid_hardware_backends
* 删除无用注释以及debug代码

* 11-01/09:45
* 更新变量命名方式

* 11-01/10:16
* 修改部分文档，修改函数命名方式

Co-authored-by: Jason <jiangjiajun@baidu.com>
 2022-11-01 11:14:05 +08:00
Jason
bb00e0757e [Model] Integrate FlyCV image processing library (#375) 
* Add falcon cmake

* Update CMakeLists.txt

* Add implementation for more preprocessors

* Add more implementation

* Add more implementations by flycv

* Fix some name

* fix some bug

* ready to test

* add fuse

* fix fuse problem

* add debug code

* add debug

* [Android] integrate flycv to Android (#459)

* [Android] integrate flycv into Andorid

* Falconcv (#27)

* [Bug Fix ]Update ppseg visualize python api && demo (#454)

Update ppseg visualize python api && demo

* [Model] update pptracking letterboxresize and add some comment (#438)

* add override mark

* delete some

* recovery

* recovery

* add tracking

* add tracking py_bind and example

* add pptracking

* add pptracking

* iomanip head file

* add opencv_video lib

* add python libs package

Signed-off-by: ChaoII <849453582@qq.com>

* complete comments

Signed-off-by: ChaoII <849453582@qq.com>

* add jdeTracker_ member variable

Signed-off-by: ChaoII <849453582@qq.com>

* add 'FASTDEPLOY_DECL' macro

Signed-off-by: ChaoII <849453582@qq.com>

* remove kwargs params

Signed-off-by: ChaoII <849453582@qq.com>

* [Doc]update pptracking docs

* delete 'ENABLE_PADDLE_FRONTEND' switch

* add pptracking unit test

* update pptracking unit test

Signed-off-by: ChaoII <849453582@qq.com>

* modify test video file path and remove trt test

* update unit test model url

* remove 'FASTDEPLOY_DECL' macro

Signed-off-by: ChaoII <849453582@qq.com>

* fix build python packages about pptracking on win32

Signed-off-by: ChaoII <849453582@qq.com>

* update comment

Signed-off-by: ChaoII <849453582@qq.com>

* add pptracking model explain

Signed-off-by: ChaoII <849453582@qq.com>

Signed-off-by: ChaoII <849453582@qq.com>
Co-authored-by: Jason <jiangjiajun@baidu.com>

Signed-off-by: ChaoII <849453582@qq.com>
Co-authored-by: huangjianhui <852142024@qq.com>
Co-authored-by: ChaoII <849453582@qq.com>
Co-authored-by: Jason <jiangjiajun@baidu.com>

* [cmake] optimize examples CMakeLists.txt

Signed-off-by: ChaoII <849453582@qq.com>
Co-authored-by: huangjianhui <852142024@qq.com>
Co-authored-by: ChaoII <849453582@qq.com>
Co-authored-by: Jason <jiangjiajun@baidu.com>

* remove debug log

* remove function

* remove function

Signed-off-by: ChaoII <849453582@qq.com>
Co-authored-by: DefTruth <31974251+DefTruth@users.noreply.github.com>
Co-authored-by: huangjianhui <852142024@qq.com>
Co-authored-by: ChaoII <849453582@qq.com>
 2022-11-01 10:42:52 +08:00
Jason
c76992c906 [Backend] Fix version of Paddle Inference with IPU (#467) 
Fix version of Paddle Inference with IPU
 2022-11-01 10:13:44 +08:00
Jack Zhou
f2747133d6 [Quantization] Update the paddle inference library to support quantization (#455) 
Update the paddle inference version in linux x64 gpu, windows gpu

Co-authored-by: Jason <jiangjiajun@baidu.com>
 2022-10-31 16:33:34 +08:00
czr-gc
ede59af857 [Backend] support ipu in paddle inference backend. (#437) 
* feat(ipu): add ipu support for paddle_infer backend.

* fix(): remove unused env.

* fix(ipu): simplify user API for IPU.

* fix(cmake): fix merge conflict error in CMakeList.

Co-authored-by: Jason <jiangjiajun@baidu.com>
 2022-10-30 18:59:59 +08:00
ChaoII
ba501fd963 [Model] add pptracking model (#357) 
* add override mark

* delete some

* recovery

* recovery

* add tracking

* add tracking py_bind and example

* add pptracking

* add pptracking

* iomanip head file

* add opencv_video lib

* add python libs package

Signed-off-by: ChaoII <849453582@qq.com>

* complete comments

Signed-off-by: ChaoII <849453582@qq.com>

* add jdeTracker_ member variable

Signed-off-by: ChaoII <849453582@qq.com>

* add 'FASTDEPLOY_DECL' macro

Signed-off-by: ChaoII <849453582@qq.com>

* remove kwargs params

Signed-off-by: ChaoII <849453582@qq.com>

* [Doc]update pptracking docs

* delete 'ENABLE_PADDLE_FRONTEND' switch

* add pptracking unit test

* update pptracking unit test

Signed-off-by: ChaoII <849453582@qq.com>

* modify test video file path and remove trt test

* update unit test model url

* remove 'FASTDEPLOY_DECL' macro

Signed-off-by: ChaoII <849453582@qq.com>

* fix build python packages about pptracking on win32

Signed-off-by: ChaoII <849453582@qq.com>

Signed-off-by: ChaoII <849453582@qq.com>
Co-authored-by: Jason <jiangjiajun@baidu.com>
 2022-10-26 14:27:55 +08:00
Wang Xinyu
c8d6c8244e [Model] Yolov5/v5lite/v6/v7/v7end2end: CUDA preprocessing (#370) 
* add yolo cuda preprocessing

* cmake build cuda src

* yolov5 support cuda preprocessing

* yolov5 cuda preprocessing configurable

* yolov5 update get mat data api

* yolov5 check cuda preprocess args

* refactor cuda function name

* yolo cuda preprocess padding value configurable

* yolov5 release cuda memory

* cuda preprocess pybind api update

* move use_cuda_preprocessing option to yolov5 model

* yolov5lite cuda preprocessing

* yolov6 cuda preprocessing

* yolov7 cuda preprocessing

* yolov7_e2e cuda preprocessing

* remove cuda preprocessing in runtime option

* refine log and cmake variable name

* fix model runtime ptr type

Co-authored-by: Jason <jiangjiajun@baidu.com>
 2022-10-19 16:04:58 +08:00
Jack Zhou
173bbf5af4 [Backend] Integrate TensorRT in Paddle Inference backend by default (#381) 
* Modify filter of trt

* Add Note for trt libs

* Use paddle inference with trt package

Co-authored-by: Jason <jiangjiajun@baidu.com>
 2022-10-18 15:29:06 +08:00
WJJ1995
f5c94e5471 Support Poros Backend (#188) 
* Add poros backend

* Add torch lib

* Add python3 lib

* set c++ 14 for poros

* fixed bugs

* fixed grammer bugs

* fixed grammer bugs

* fixed code bugs

* fixed code bugs

* fixed CreatePorosValue bug

* Add AtType2String for Log

* fixed trt_option

* fixed poros.cmake path

* fixed grammer bug

* fixed grammer bug

* fixed ambiguous reference

* fixed ambiguous reference

* fixed reference error

* fixed include files

* rm ENABLE_TRT_BACKEND in poros

* update CMakeLists.txt

* fixed CMakeLists.txt

* Add libtorch.so in CMakeLists.txt

* Fixed CMakeLists.txt

* Fixed CMakeLists.txt

* Fixed copy bug

* Fixed copy bug

* Fixed copy bug

* Fixed Cmake

* Fixed Cmake

* debug

* debug

* debug

* debug

* debug

* debug

* debug utils

* debug utils

* copy to cpu

* rm log info

* test share mem

* test share mem

* test share mem

* test multi outputs

* test multi outputs

* test multi outputs

* test multi outputs

* test multi outputs

* test multi outputs

* test multi outputs

* time cost

* time cost

* fixed bug

* time collect

* mem copy

* mem copy

* rm time log

* rm share mem

* fixed multi inputs bug

* add set_input_dtypes func

* add SetInputDtypes

* fixed bug

* fixed bug

* fixed prewarm data order

* debug

* debug

* debug

* debug

* debug

* debug

* debug

* debug

* debug

* debug

* debug

* fixed bug

* Add compile func

* Add compile func

* Add compile func

* Add is_dynamic option

* Add is_dynamic option

* Add is_dynamic option

* Add is_dynamic option

* rm infer log

* add cuda11.6 poros lib

* fixed bug

* fixed bug

* fixed multi outputs

* fixed multi outputs

* fixed multi outputs

* fixed multi outputs

* fixed multi outputs

* fixed multi outputs

* fixed multi outputs

* fixed multi outputs

* fixed multi outputs

* fixed multi outputs

* fixed multi outputs

* rm logs

* test

* test

* test

* add test log

* add test log

* add test log

* add test log

* support cpu

* support cpu

* support cpu

* support cpu

* support member variable definition

* rm useless log

* fixed name

* resolve conflict

* resolve conflict

* resolve conflict

* fixed cmake

* add GetInputInfos&GetOutputInfos

* add GetInputInfos&GetOutputInfos

* fixed bug

* fixed runtime.py

* add compile func

* add np

* deal with comments

* rm to_inter func

* add property
 2022-10-17 15:28:12 +08:00
DefTruth
e24c592f43 [osx] fixed mac osx arm64 and x86_64 0.3.0 rpath error (#374) 
* Update paddle_inference.cmake

* Update process_libraries.py.in

* Update process_libraries.py.in

* Update paddle_inference.cmake

* Update CMakeLists.txt

* Update VERSION_NUMBER

* Update VERSION_NUMBER

* Update download_prebuilt_libraries.md

* Update gpu.md

* Update cpu.md

* Update download_prebuilt_libraries.md

* Update jetson.md

* Update tensorrt_tricks.md

* Update cpp.md

Co-authored-by: Jason <jiangjiajun@baidu.com>
 2022-10-16 15:23:35 +08:00
Jason
3ff562aa77 Bump up to version 0.3.0 (#371) 
* Update VERSION_NUMBER

* Update paddle_inference.cmake

* Delete docs directory

* release new docs

* update version number

* add vision result doc

* update version

* fix dead link

* fix vision

* fix dead link

* Update README_EN.md

* Update README_EN.md

* Update README_EN.md

* Update README_EN.md

* Update README_EN.md

* Update README_CN.md

* Update README_EN.md

* Update README_CN.md

* Update README_EN.md

* Update README_CN.md

* Update README_EN.md

* Update README_EN.md

Co-authored-by: leiqing <54695910+leiqing1@users.noreply.github.com>
 2022-10-15 22:01:27 +08:00
Jack Zhou
e268ef08d2 Fix openvino cmake (#348) 
fix openvino
 2022-10-12 21:13:44 +08:00
Jason
e6f8bd90cf Revert Paddle Inference to No TRT version (#355) 2022-10-12 19:39:37 +08:00
Jason
945e197bd1 Fix bug of get input/output information from PaddleBackend (#339) 
* Fix bug of get input/output information from PaddleBackend

* Support Paddle Inference with TensorRT (#340)

* Fix bug
 2022-10-12 11:37:26 +08:00