yeliang2258
7206094ddd
[Backend] Add ORT CPU and CUDA kernel for adaptive_pool OP ( #609 )
...
* add ORT CPU and CUDA kernel for adaptive_pool
* update code
* update paddle2onnx version
2022-11-24 10:39:29 +08:00
Jack Zhou
eeae48deff
[Other] faster_tokenizer->fast_tokenizer ( #636 )
...
* faster_tokenizer->fast_tokenizer
* ErnieFasterTokenizer->ErnieFastTokenizer
* update the fastdeploy_init
Co-authored-by: Jason <jiangjiajun@baidu.com >
2022-11-21 13:45:00 +08:00
DefTruth
ac805c26d9
[Bug Fix] fix FastDeploy.cmake.in errors for Android ( #616 )
...
* [Backend] fix lite backend save model error
* [Backend] fixed typos
* [FlyCV] optimize the integration of FlyCV
* [cmake] close some tests options
* [cmake] close some test option
* [FlyCV] remove un-need warnings
* [FlyCV] remove un-need GetMat method
* [FlyCV] optimize FlyCV codes
* [cmake] remove un-need cmake function in examples/CMakelists
* [cmake] support gflags for Android
* [Android] Run button shutter in sub Ui Thread
* [Android] Update CameraSurfaceView
* [Android] Update Android SDK usage docs
* [Android] Add facedet Android app example
* [cmake] fix FastDeploy.cmake.in errors for Android
* [Doc] update SetProcLibCpuNumThreads API doc
2022-11-16 22:33:04 +08:00
DefTruth
6a368f3448
[Android] Support segmentation and facedet in Android ( #567 )
...
* [FlyCV] Add global SetProcLibCpuNumThreads method
* [Android] Support segmentation and facedet in Android
* [Android] add JNI instance check to j_runtime_option_obj
* [Model] fixed ppseg flycv resize error
* [FlyCV] fix FlyCV resize flags
* [cmake] remove un-need lite compile option
* [Android] add PaddleSegModel JNI and fix some bugs
* [Android] bind PaddleSegModel via JNI
* [Android] bind VisSegmentation via JNI
* [Android] bind YOLOv5Face and SCRFD via JNI
* [Android] fix NewJavaFaceDetectionResultFromCxx error
2022-11-13 17:47:50 +08:00
yeliang2258
f74974c4a5
[Backend] Update p2o version to 1.0.3 ( #570 )
...
update p2o version to 1.0.3
2022-11-12 09:38:23 +08:00
yeliang2258
fa807340be
[Backend] Add Rockchip RV1126 deploy support through PaddleLite TIM-VX ( #439 )
...
* add rk1126 support
* update lib
* fix compile bugs
* update doc
* fix complie bug
* update doc
* update doc
* update code
* support model bigger than 2G
* update code
* update code
* update code
* update doc
* update code
* fix bug
* update code
* update code
* update code
* update doc
* update info
* code style check
* update code
* update doc
Co-authored-by: Jason <jiangjiajun@baidu.com >
2022-11-10 10:05:47 +08:00
Jason
30412cb599
Update paddle2onnx.cmake
2022-11-09 15:32:48 +08:00
yeliang2258
8d31fe59e8
[Backend] Support the deployment of models which is larger than 2G in ORT and TRT backend ( #514 )
...
* support model bigger than 2G
* update code
* update code
* fix bug
* update code
2022-11-09 11:14:15 +08:00
DefTruth
295af8f467
[FlyCV] update vision processors with latest FlyCV API ( #503 )
...
* [Other] Add static create methods to Mat
* [Other] avoid field name conflicts
* [FlyCV] update vision processors with latest FlyCV API
* [FlyCV] update vision processors with latest FlyCV API
* [Model] update rvm cv::Mat usage to FD Mat usage
2022-11-06 13:29:46 +08:00
Jason
9fa612c24b
[Backend] Enable TensorRT BatchedNMSDynamic_TRT plugin ( #449 )
...
* Enable TensorRT EfficientNMS plugin
* remove some temporary code
* Update trt_backend.cc
* Update utils.h
2022-11-04 11:46:29 +08:00
DefTruth
a36d49a973
[FlyCV] optimize the integration of FlyCV ( #492 )
...
* [Backend] fix lite backend save model error
* [Backend] fixed typos
* [FlyCV] optimize the integration of FlyCV
* [cmake] close some tests options
* [cmake] close some test option
* [FlyCV] remove un-need warnings
* [FlyCV] remove un-need GetMat method
* [FlyCV] optimize FlyCV codes
* [cmake] remove un-need cmake function in examples/CMakelists
* [cmake] support gflags for Android
2022-11-04 09:19:03 +08:00
WJJ1995
9437dec9f5
[Model] add PFLD model ( #433 )
...
* support face alignment PFLD
* add PFLD demo
* fixed FaceAlignmentResult
* fixed bugs
* fixed img size
* fixed readme
* deal with comments
* fixed readme
* add pfld testcase
* update infer.py
* add gflags for example
* update c++ readme
* add gflags in example
* fixed for ci
* fixed gflags.cmake
* deal with comments
* update infer demo
Co-authored-by: Jason <jiangjiajun@baidu.com >
2022-11-02 11:50:16 +08:00
Wang Xinyu
e5c955dd3e
[Model] yolo use external stream, avoid reallocating output tensors ( #447 )
...
* yolov5 use external stream
* yolov5lite/v6/v7/v7e2etrt: optimize output tensor and cuda stream
* avoid reallocating output tensors
* add input output tensors to FastDeployModel
* add cuda.cmake
* rename to reused_input/output_tensors
* eliminate cmake cuda arch error
* use swap to release input and output tensors
Co-authored-by: Jason <jiangjiajun@baidu.com >
2022-11-02 09:52:27 +08:00
Zheng_Bicheng
4ffcfbe726
[Backend] Add RKNPU2 backend support ( #456 )
...
* 10-29/14:05
* 新增cmake
* 新增rknpu2 backend
* 10-29/14:43
* Runtime fd_type新增RKNPU代码
* 10-29/15:02
* 新增ppseg RKNPU2推理代码
* 10-29/15:46
* 新增ppseg RKNPU2 cpp example代码
* 10-29/15:51
* 新增README文档
* 10-29/15:51
* 按照要求修改部分注释以及变量名称
* 10-29/15:51
* 修复重命名之后，cc文件中的部分代码还用旧函数名的bug
* 10-29/22:32
* str(Device::NPU)将输出NPU而不是UNKOWN
* 修改runtime文件中的注释格式
* 新增Building Summary ENABLE_RKNPU2_BACKEND输出
* pybind新增支持rknpu2
* 新增python编译选项
* 新增PPSeg Python代码
* 新增以及更新各种文档
* 10-30/14:11
* 尝试修复编译cuda时产生的错误
* 10-30/19:27
* 修改CpuName和CoreMask层级
* 修改ppseg rknn推理层级
* 图片将移动到网络进行下载
* 10-30/19:39
* 更新文档
* 10-30/19:39
* 更新文档
* 更新ppseg rknpu2 example中的函数命名方式
* 更新ppseg rknpu2 example为一个cc文件
* 修复disable_normalize_and_permute部分的逻辑错误
* 移除rknpu2初始化时的无用参数
* 10-30/19:39
* 尝试重置python代码
* 10-30/10:16
* rknpu2_config.h文件不再包含rknn_api头文件防止出现导入错误的问题
* 10-31/14:31
* 修改pybind，支持最新的rknpu2 backends
* 再次支持ppseg python推理
* 移动cpuname 和 coremask的层级
* 10-31/15:35
* 尝试修复rknpu2导入错误
* 10-31/19:00
* 新增RKNPU2模型导出代码以及其对应的文档
* 更新大量文档错误
* 10-31/19:00
* 现在编译完fastdeploy仓库后无需重新设置RKNN2_TARGET_SOC
* 10-31/19:26
* 修改部分错误文档
* 10-31/19:26
* 修复错误删除的部分
* 修复各种错误文档
* 修复FastDeploy.cmake在设置RKNN2_TARGET_SOC错误时，提示错误的信息
* 修复rknpu2_backend.cc中存在的中文注释
* 10-31/20:45
* 删除无用的注释
* 10-31/20:45
* 按照要求修改Device::NPU为Device::RKNPU，硬件将共用valid_hardware_backends
* 删除无用注释以及debug代码
* 11-01/09:45
* 更新变量命名方式
* 11-01/10:16
* 修改部分文档，修改函数命名方式
Co-authored-by: Jason <jiangjiajun@baidu.com >
2022-11-01 11:14:05 +08:00
Jason
bb00e0757e
[Model] Integrate FlyCV image processing library ( #375 )
...
* Add falcon cmake
* Update CMakeLists.txt
* Add implementation for more preprocessors
* Add more implementation
* Add more implementations by flycv
* Fix some name
* fix some bug
* ready to test
* add fuse
* fix fuse problem
* add debug code
* add debug
* [Android] integrate flycv to Android (#459 )
* [Android] integrate flycv into Andorid
* Falconcv (#27 )
* [Bug Fix ]Update ppseg visualize python api && demo (#454 )
Update ppseg visualize python api && demo
* [Model] update pptracking letterboxresize and add some comment (#438 )
* add override mark
* delete some
* recovery
* recovery
* add tracking
* add tracking py_bind and example
* add pptracking
* add pptracking
* iomanip head file
* add opencv_video lib
* add python libs package
Signed-off-by: ChaoII <849453582@qq.com >
* complete comments
Signed-off-by: ChaoII <849453582@qq.com >
* add jdeTracker_ member variable
Signed-off-by: ChaoII <849453582@qq.com >
* add 'FASTDEPLOY_DECL' macro
Signed-off-by: ChaoII <849453582@qq.com >
* remove kwargs params
Signed-off-by: ChaoII <849453582@qq.com >
* [Doc]update pptracking docs
* delete 'ENABLE_PADDLE_FRONTEND' switch
* add pptracking unit test
* update pptracking unit test
Signed-off-by: ChaoII <849453582@qq.com >
* modify test video file path and remove trt test
* update unit test model url
* remove 'FASTDEPLOY_DECL' macro
Signed-off-by: ChaoII <849453582@qq.com >
* fix build python packages about pptracking on win32
Signed-off-by: ChaoII <849453582@qq.com >
* update comment
Signed-off-by: ChaoII <849453582@qq.com >
* add pptracking model explain
Signed-off-by: ChaoII <849453582@qq.com >
Signed-off-by: ChaoII <849453582@qq.com >
Co-authored-by: Jason <jiangjiajun@baidu.com >
Signed-off-by: ChaoII <849453582@qq.com >
Co-authored-by: huangjianhui <852142024@qq.com >
Co-authored-by: ChaoII <849453582@qq.com >
Co-authored-by: Jason <jiangjiajun@baidu.com >
* [cmake] optimize examples CMakeLists.txt
Signed-off-by: ChaoII <849453582@qq.com >
Co-authored-by: huangjianhui <852142024@qq.com >
Co-authored-by: ChaoII <849453582@qq.com >
Co-authored-by: Jason <jiangjiajun@baidu.com >
* remove debug log
* remove function
* remove function
Signed-off-by: ChaoII <849453582@qq.com >
Co-authored-by: DefTruth <31974251+DefTruth@users.noreply.github.com >
Co-authored-by: huangjianhui <852142024@qq.com >
Co-authored-by: ChaoII <849453582@qq.com >
2022-11-01 10:42:52 +08:00
Jason
c76992c906
[Backend] Fix version of Paddle Inference with IPU ( #467 )
...
Fix version of Paddle Inference with IPU
2022-11-01 10:13:44 +08:00
Jack Zhou
f2747133d6
[Quantization] Update the paddle inference library to support quantization ( #455 )
...
Update the paddle inference version in linux x64 gpu, windows gpu
Co-authored-by: Jason <jiangjiajun@baidu.com >
2022-10-31 16:33:34 +08:00
czr-gc
ede59af857
[Backend] support ipu in paddle inference backend. ( #437 )
...
* feat(ipu): add ipu support for paddle_infer backend.
* fix(): remove unused env.
* fix(ipu): simplify user API for IPU.
* fix(cmake): fix merge conflict error in CMakeList.
Co-authored-by: Jason <jiangjiajun@baidu.com >
2022-10-30 18:59:59 +08:00
ChaoII
ba501fd963
[Model] add pptracking model ( #357 )
...
* add override mark
* delete some
* recovery
* recovery
* add tracking
* add tracking py_bind and example
* add pptracking
* add pptracking
* iomanip head file
* add opencv_video lib
* add python libs package
Signed-off-by: ChaoII <849453582@qq.com >
* complete comments
Signed-off-by: ChaoII <849453582@qq.com >
* add jdeTracker_ member variable
Signed-off-by: ChaoII <849453582@qq.com >
* add 'FASTDEPLOY_DECL' macro
Signed-off-by: ChaoII <849453582@qq.com >
* remove kwargs params
Signed-off-by: ChaoII <849453582@qq.com >
* [Doc]update pptracking docs
* delete 'ENABLE_PADDLE_FRONTEND' switch
* add pptracking unit test
* update pptracking unit test
Signed-off-by: ChaoII <849453582@qq.com >
* modify test video file path and remove trt test
* update unit test model url
* remove 'FASTDEPLOY_DECL' macro
Signed-off-by: ChaoII <849453582@qq.com >
* fix build python packages about pptracking on win32
Signed-off-by: ChaoII <849453582@qq.com >
Signed-off-by: ChaoII <849453582@qq.com >
Co-authored-by: Jason <jiangjiajun@baidu.com >
2022-10-26 14:27:55 +08:00
Wang Xinyu
c8d6c8244e
[Model] Yolov5/v5lite/v6/v7/v7end2end: CUDA preprocessing ( #370 )
...
* add yolo cuda preprocessing
* cmake build cuda src
* yolov5 support cuda preprocessing
* yolov5 cuda preprocessing configurable
* yolov5 update get mat data api
* yolov5 check cuda preprocess args
* refactor cuda function name
* yolo cuda preprocess padding value configurable
* yolov5 release cuda memory
* cuda preprocess pybind api update
* move use_cuda_preprocessing option to yolov5 model
* yolov5lite cuda preprocessing
* yolov6 cuda preprocessing
* yolov7 cuda preprocessing
* yolov7_e2e cuda preprocessing
* remove cuda preprocessing in runtime option
* refine log and cmake variable name
* fix model runtime ptr type
Co-authored-by: Jason <jiangjiajun@baidu.com >
2022-10-19 16:04:58 +08:00
Jack Zhou
173bbf5af4
[Backend] Integrate TensorRT in Paddle Inference backend by default ( #381 )
...
* Modify filter of trt
* Add Note for trt libs
* Use paddle inference with trt package
Co-authored-by: Jason <jiangjiajun@baidu.com >
2022-10-18 15:29:06 +08:00
WJJ1995
f5c94e5471
Support Poros Backend ( #188 )
...
* Add poros backend
* Add torch lib
* Add python3 lib
* set c++ 14 for poros
* fixed bugs
* fixed grammer bugs
* fixed grammer bugs
* fixed code bugs
* fixed code bugs
* fixed CreatePorosValue bug
* Add AtType2String for Log
* fixed trt_option
* fixed poros.cmake path
* fixed grammer bug
* fixed grammer bug
* fixed ambiguous reference
* fixed ambiguous reference
* fixed reference error
* fixed include files
* rm ENABLE_TRT_BACKEND in poros
* update CMakeLists.txt
* fixed CMakeLists.txt
* Add libtorch.so in CMakeLists.txt
* Fixed CMakeLists.txt
* Fixed CMakeLists.txt
* Fixed copy bug
* Fixed copy bug
* Fixed copy bug
* Fixed Cmake
* Fixed Cmake
* debug
* debug
* debug
* debug
* debug
* debug
* debug utils
* debug utils
* copy to cpu
* rm log info
* test share mem
* test share mem
* test share mem
* test multi outputs
* test multi outputs
* test multi outputs
* test multi outputs
* test multi outputs
* test multi outputs
* test multi outputs
* time cost
* time cost
* fixed bug
* time collect
* mem copy
* mem copy
* rm time log
* rm share mem
* fixed multi inputs bug
* add set_input_dtypes func
* add SetInputDtypes
* fixed bug
* fixed bug
* fixed prewarm data order
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* fixed bug
* Add compile func
* Add compile func
* Add compile func
* Add is_dynamic option
* Add is_dynamic option
* Add is_dynamic option
* Add is_dynamic option
* rm infer log
* add cuda11.6 poros lib
* fixed bug
* fixed bug
* fixed multi outputs
* fixed multi outputs
* fixed multi outputs
* fixed multi outputs
* fixed multi outputs
* fixed multi outputs
* fixed multi outputs
* fixed multi outputs
* fixed multi outputs
* fixed multi outputs
* fixed multi outputs
* rm logs
* test
* test
* test
* add test log
* add test log
* add test log
* add test log
* support cpu
* support cpu
* support cpu
* support cpu
* support member variable definition
* rm useless log
* fixed name
* resolve conflict
* resolve conflict
* resolve conflict
* fixed cmake
* add GetInputInfos&GetOutputInfos
* add GetInputInfos&GetOutputInfos
* fixed bug
* fixed runtime.py
* add compile func
* add np
* deal with comments
* rm to_inter func
* add property
2022-10-17 15:28:12 +08:00
DefTruth
e24c592f43
[osx] fixed mac osx arm64 and x86_64 0.3.0 rpath error ( #374 )
...
* Update paddle_inference.cmake
* Update process_libraries.py.in
* Update process_libraries.py.in
* Update paddle_inference.cmake
* Update CMakeLists.txt
* Update VERSION_NUMBER
* Update VERSION_NUMBER
* Update download_prebuilt_libraries.md
* Update gpu.md
* Update cpu.md
* Update download_prebuilt_libraries.md
* Update jetson.md
* Update tensorrt_tricks.md
* Update cpp.md
Co-authored-by: Jason <jiangjiajun@baidu.com >
2022-10-16 15:23:35 +08:00
Jason
3ff562aa77
Bump up to version 0.3.0 ( #371 )
...
* Update VERSION_NUMBER
* Update paddle_inference.cmake
* Delete docs directory
* release new docs
* update version number
* add vision result doc
* update version
* fix dead link
* fix vision
* fix dead link
* Update README_EN.md
* Update README_EN.md
* Update README_EN.md
* Update README_EN.md
* Update README_EN.md
* Update README_CN.md
* Update README_EN.md
* Update README_CN.md
* Update README_EN.md
* Update README_CN.md
* Update README_EN.md
* Update README_EN.md
Co-authored-by: leiqing <54695910+leiqing1@users.noreply.github.com >
2022-10-15 22:01:27 +08:00
Jack Zhou
e268ef08d2
Fix openvino cmake ( #348 )
...
fix openvino
2022-10-12 21:13:44 +08:00
Jason
e6f8bd90cf
Revert Paddle Inference to No TRT version ( #355 )
2022-10-12 19:39:37 +08:00
Jason
945e197bd1
Fix bug of get input/output information from PaddleBackend ( #339 )
...
* Fix bug of get input/output information from PaddleBackend
* Support Paddle Inference with TensorRT (#340 )
* Fix bug
2022-10-12 11:37:26 +08:00
yeliang2258
2a68a23baf
Add paddle quantize model support for ORT, TRT and MKLDNN deploy backend ( #257 )
...
* add quantize model support for trt and paddle
* fix bugs
* fix
* update paddle2onnx version
* update version
* add quantize test
Co-authored-by: Jason <jiangjiajun@baidu.com >
2022-10-09 20:00:05 +08:00
DefTruth
584ba3de68
[win] Add fastdeploy_init.bat and update docs ( #320 )
...
* [cmake] support Android arm64-v8a & armeabi-v7a native c++ sdk
* [cmake] fixed patchelf download on mac and android
* [lite] Add threads and power_mode option support
* [pybind] update runtime pybind for lite power mode
* [python] Add set_lite_power_mode api to runtime
* [Lite] add lite enable_fp16 option support
* [lite] add more options for lite backend.
* [cmake] fixed Paddle Lite typo
* [runtime] format LitePowerMode enum comments
* [runtime] format lite option comments
* [win] Add fastdeploy_init.bat and update docs
* [win] Add fastdeploy_init.bat and update docs
2022-10-06 15:57:18 +08:00
DefTruth
c4288a92e1
[lite] add more options for lite backend ( #313 )
...
* [cmake] support Android arm64-v8a & armeabi-v7a native c++ sdk
* [cmake] fixed patchelf download on mac and android
* [lite] Add threads and power_mode option support
* [pybind] update runtime pybind for lite power mode
* [python] Add set_lite_power_mode api to runtime
* [Lite] add lite enable_fp16 option support
* [lite] add more options for lite backend.
* [cmake] fixed Paddle Lite typo
* [runtime] format LitePowerMode enum comments
* [runtime] format lite option comments
2022-10-04 17:31:48 +08:00
ChaoII
97bcf5ac5d
[cmake]fix find tbb package in utils.cmake
2022-09-29 11:38:16 +08:00
ChaoII
de88bb61c7
Update opencv.cmake
2022-09-28 18:18:20 +08:00
ChaoII
68e049d93f
[fix] # Win/Linux/Mac specified opencv path unable to take effect
2022-09-28 18:09:39 +08:00
DefTruth
42d8b300f4
[cmake] fixed patchelf download on mac and android ( #296 )
...
* [cmake] support Android arm64-v8a & armeabi-v7a native c++ sdk
* [cmake] fixed patchelf download on mac and android
2022-09-28 14:46:50 +08:00
Jason
7af1fa0946
Fix patchelf problem ( #295 )
...
fix patchelf
2022-09-28 12:33:32 +08:00
Jason
311a59c62d
Add patchelf to solve the build problem on Linux without patchelf ( #291 )
...
* add patchelf as tool
* Update CMakeLists.txt
2022-09-28 10:48:49 +08:00
DefTruth
4ead287f5a
[cmake] support Android armv8 & armv7 native c++ sdk ( #288 )
...
[cmake] support Android arm64-v8a & armeabi-v7a native c++ sdk
2022-09-27 20:58:44 +08:00
Jason
1f35f2036e
Decrease wheel package size ( #287 )
...
* Decrease wheel package size
* Decrease wheel package size
* Decrease wheel package size
2022-09-27 18:02:34 +08:00
Jason
d855c28073
Rename third libraries' name ( #286 )
...
* Rename third libraries' name
* remove existing directory
2022-09-27 14:16:34 +08:00
Jack Zhou
b83cb993ac
Simplify cmake and add openvino directory ( #285 )
...
* simplify the opencv.cmake
* Add OPENVINO_DIRECTORY option
* Add openvino directory
2022-09-27 10:02:34 +08:00
DefTruth
9e09a55abb
[docs] update win build docs with cmake-gui+vs2019 ( #280 )
...
* Delete redundant Chinese comments
* [docs] update win build docs with cmake-gui+vs2019
* [docs] update win build docs with cmake-gui+vs2019
* [examples] replace some cn comments with en
* [cmake] update FastDeploy.cmake.in
* [docs] update windows c++ sdk usage docs
* [cmake] update FastDeploy.cmake.in
* [docs] update windows sdk usage docs
Co-authored-by: Jason <jiangjiajun@baidu.com >
2022-09-26 19:25:12 +08:00
Jack Zhou
355382ad63
Move eigen to third party ( #282 )
...
* remove useless statement
* Add eigen to third_party dir
* remove reducdant lines
2022-09-26 19:24:02 +08:00
jiangjiajun
85c44d562e
Merge branch 'develop' of https://github.com/PaddlePaddle/FastDeploy into develop
2022-09-26 16:19:58 +08:00
jiangjiajun
4af89d27dc
Optimize build on jetson
2022-09-26 16:19:36 +08:00
Jason
4421fc5a8f
Merge branch 'develop' into add_openvino_mac
2022-09-26 11:32:15 +08:00
Jason
12fed103e6
Update eigen.cmake
2022-09-26 11:31:35 +08:00
zhoushunjie
ad03e771dd
Add remove_duplicate_libraries function
2022-09-26 11:24:57 +08:00
zhoushunjie
f142fcdf60
Add get_openvino_libs
2022-09-25 18:26:04 +08:00
zhoushunjie
870c22c8e9
fix windows bug
2022-09-25 11:56:30 +08:00
zhoushunjie
c53d8fd82c
Fix windows compile bug
2022-09-25 11:43:16 +08:00
