Jason
3589c0fa94
[Model] Refactor PaddleClas module ( #505 )
...
* Refactor the PaddleClas module
* fix bug
* remove debug code
* clean unused code
* support pybind
* Update fd_tensor.h
* Update fd_tensor.cc
* temporary revert python api
* fix ci error
* fix code style problem
2022-11-07 19:33:47 +08:00
Jason
6633fa3db9
[Model] [Part 1] Refactor PaddleClas module ( #508 )
...
* Split PaddleClas Module refactor
* Split PaddleClas Module refactor
* fix bug
2022-11-07 15:09:00 +08:00
Zheng_Bicheng
4ffcfbe726
[Backend] Add RKNPU2 backend support ( #456 )
...
* 10-29/14:05
* 新增cmake
* 新增rknpu2 backend
* 10-29/14:43
* Runtime fd_type新增RKNPU代码
* 10-29/15:02
* 新增ppseg RKNPU2推理代码
* 10-29/15:46
* 新增ppseg RKNPU2 cpp example代码
* 10-29/15:51
* 新增README文档
* 10-29/15:51
* 按照要求修改部分注释以及变量名称
* 10-29/15:51
* 修复重命名之后，cc文件中的部分代码还用旧函数名的bug
* 10-29/22:32
* str(Device::NPU)将输出NPU而不是UNKOWN
* 修改runtime文件中的注释格式
* 新增Building Summary ENABLE_RKNPU2_BACKEND输出
* pybind新增支持rknpu2
* 新增python编译选项
* 新增PPSeg Python代码
* 新增以及更新各种文档
* 10-30/14:11
* 尝试修复编译cuda时产生的错误
* 10-30/19:27
* 修改CpuName和CoreMask层级
* 修改ppseg rknn推理层级
* 图片将移动到网络进行下载
* 10-30/19:39
* 更新文档
* 10-30/19:39
* 更新文档
* 更新ppseg rknpu2 example中的函数命名方式
* 更新ppseg rknpu2 example为一个cc文件
* 修复disable_normalize_and_permute部分的逻辑错误
* 移除rknpu2初始化时的无用参数
* 10-30/19:39
* 尝试重置python代码
* 10-30/10:16
* rknpu2_config.h文件不再包含rknn_api头文件防止出现导入错误的问题
* 10-31/14:31
* 修改pybind，支持最新的rknpu2 backends
* 再次支持ppseg python推理
* 移动cpuname 和 coremask的层级
* 10-31/15:35
* 尝试修复rknpu2导入错误
* 10-31/19:00
* 新增RKNPU2模型导出代码以及其对应的文档
* 更新大量文档错误
* 10-31/19:00
* 现在编译完fastdeploy仓库后无需重新设置RKNN2_TARGET_SOC
* 10-31/19:26
* 修改部分错误文档
* 10-31/19:26
* 修复错误删除的部分
* 修复各种错误文档
* 修复FastDeploy.cmake在设置RKNN2_TARGET_SOC错误时，提示错误的信息
* 修复rknpu2_backend.cc中存在的中文注释
* 10-31/20:45
* 删除无用的注释
* 10-31/20:45
* 按照要求修改Device::NPU为Device::RKNPU，硬件将共用valid_hardware_backends
* 删除无用注释以及debug代码
* 11-01/09:45
* 更新变量命名方式
* 11-01/10:16
* 修改部分文档，修改函数命名方式
Co-authored-by: Jason <jiangjiajun@baidu.com >
2022-11-01 11:14:05 +08:00
czr-gc
ede59af857
[Backend] support ipu in paddle inference backend. ( #437 )
...
* feat(ipu): add ipu support for paddle_infer backend.
* fix(): remove unused env.
* fix(ipu): simplify user API for IPU.
* fix(cmake): fix merge conflict error in CMakeList.
Co-authored-by: Jason <jiangjiajun@baidu.com >
2022-10-30 18:59:59 +08:00
heliqi
b064ddf7ed
[Serving][backend]serving support multi stream and backend support external stream ( #431 )
...
* serving support multi stream
* pybind add external stream
Co-authored-by: Jason <jiangjiajun@baidu.com >
2022-10-26 14:46:13 +08:00
Wang Xinyu
43d86114d8
[Backend] TRT backend & PP-Infer backend support pinned memory ( #403 )
...
* TRT backend use pinned memory
* refine fd tensor pinned memory logic
* TRT enable pinned memory configurable
* paddle inference support pinned memory
* pinned memory pybindings
Co-authored-by: Jason <jiangjiajun@baidu.com >
2022-10-21 18:51:36 +08:00
huangjianhui
b565c15bf7
[Model] Add tinypose single && pipeline model ( #177 )
...
* Add tinypose model
* Add PPTinypose python API
* Fix picodet preprocess bug && Add Tinypose examples
* Update tinypose example code
* Update ppseg preprocess if condition
* Update ppseg backend support type
* Update permute.h
* Update README.md
* Update code with comments
* Move files dir
* Delete premute.cc
* Add single model pptinypose
* Delete pptinypose old code in ppdet
* Code format
* Add ppdet + pptinypose pipeline model
* Fix bug for posedetpipeline
* Change Frontend to ModelFormat
* Change Frontend to ModelFormat in __init__.py
* Add python posedetpipeline/
* Update pptinypose example dir name
* Update README.md
* Update README.md
* Update README.md
* Update README.md
* Create keypointdetection_result.md
* Create README.md
* Create README.md
* Create README.md
* Update README.md
* Update README.md
* Create README.md
* Fix det_keypoint_unite_infer.py bug
* Create README.md
* Update PP-Tinypose by comment
* Update by comment
* Add pipeline directory
* Add pptinypose dir
* Update pptinypose to align accuracy
* Addd warpAffine processor
* Update GetCpuMat to GetOpenCVMat
* Add comment for pptinypose && pipline
* Update docs/main_page.md
* Add README.md for pptinypose
* Add README for det_keypoint_unite
* Remove ENABLE_PIPELINE option
* Remove ENABLE_PIPELINE option
* Change pptinypose default backend
* PP-TinyPose Pipeline support multi PP-Detection models
* Update pp-tinypose comment
* Update by comments
* Add single test example
Co-authored-by: Jason <jiangjiajun@baidu.com >
2022-10-21 09:28:23 +08:00
Jack Zhou
dccb737d8d
[Backend] Add collect shape for pp-trt backend ( #372 )
...
* Add collect_shape attr
* add EnableTunedTensorRtDynamicShape
* Add collect shape python api
* Fix quant model not set trt dynamic shape
* Add shape info print
* Fix shape print
* Use CopyFromCpu instead of ShareExternalData
* Add ENABLE_TRT_BACKEND macro
* Add shared data with
2022-10-20 17:02:56 +08:00
WJJ1995
f5c94e5471
Support Poros Backend ( #188 )
...
* Add poros backend
* Add torch lib
* Add python3 lib
* set c++ 14 for poros
* fixed bugs
* fixed grammer bugs
* fixed grammer bugs
* fixed code bugs
* fixed code bugs
* fixed CreatePorosValue bug
* Add AtType2String for Log
* fixed trt_option
* fixed poros.cmake path
* fixed grammer bug
* fixed grammer bug
* fixed ambiguous reference
* fixed ambiguous reference
* fixed reference error
* fixed include files
* rm ENABLE_TRT_BACKEND in poros
* update CMakeLists.txt
* fixed CMakeLists.txt
* Add libtorch.so in CMakeLists.txt
* Fixed CMakeLists.txt
* Fixed CMakeLists.txt
* Fixed copy bug
* Fixed copy bug
* Fixed copy bug
* Fixed Cmake
* Fixed Cmake
* debug
* debug
* debug
* debug
* debug
* debug
* debug utils
* debug utils
* copy to cpu
* rm log info
* test share mem
* test share mem
* test share mem
* test multi outputs
* test multi outputs
* test multi outputs
* test multi outputs
* test multi outputs
* test multi outputs
* test multi outputs
* time cost
* time cost
* fixed bug
* time collect
* mem copy
* mem copy
* rm time log
* rm share mem
* fixed multi inputs bug
* add set_input_dtypes func
* add SetInputDtypes
* fixed bug
* fixed bug
* fixed prewarm data order
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* fixed bug
* Add compile func
* Add compile func
* Add compile func
* Add is_dynamic option
* Add is_dynamic option
* Add is_dynamic option
* Add is_dynamic option
* rm infer log
* add cuda11.6 poros lib
* fixed bug
* fixed bug
* fixed multi outputs
* fixed multi outputs
* fixed multi outputs
* fixed multi outputs
* fixed multi outputs
* fixed multi outputs
* fixed multi outputs
* fixed multi outputs
* fixed multi outputs
* fixed multi outputs
* fixed multi outputs
* rm logs
* test
* test
* test
* add test log
* add test log
* add test log
* add test log
* support cpu
* support cpu
* support cpu
* support cpu
* support member variable definition
* rm useless log
* fixed name
* resolve conflict
* resolve conflict
* resolve conflict
* fixed cmake
* add GetInputInfos&GetOutputInfos
* add GetInputInfos&GetOutputInfos
* fixed bug
* fixed runtime.py
* add compile func
* add np
* deal with comments
* rm to_inter func
* add property
2022-10-17 15:28:12 +08:00
Jason
945e197bd1
Fix bug of get input/output information from PaddleBackend ( #339 )
...
* Fix bug of get input/output information from PaddleBackend
* Support Paddle Inference with TensorRT (#340 )
* Fix bug
2022-10-12 11:37:26 +08:00
yeliang2258
2a68a23baf
Add paddle quantize model support for ORT, TRT and MKLDNN deploy backend ( #257 )
...
* add quantize model support for trt and paddle
* fix bugs
* fix
* update paddle2onnx version
* update version
* add quantize test
Co-authored-by: Jason <jiangjiajun@baidu.com >
2022-10-09 20:00:05 +08:00
heliqi
d57e997fa0
Fd serving add docker images correlation and docs ( #311 )
...
* fd serving add dockerfile
* fix enable_paddle_mkldnn
* delete disable_paddle_mkldnn
Co-authored-by: Jason <jiangjiajun@baidu.com >
2022-10-08 16:08:07 +08:00
Jason
a8e08c9c1a
Merge branch 'develop' into add_float16_dtype
2022-10-05 10:47:52 +08:00
zhoushunjie
6e4319348b
add float16
2022-10-05 02:44:39 +00:00
DefTruth
c4288a92e1
[lite] add more options for lite backend ( #313 )
...
* [cmake] support Android arm64-v8a & armeabi-v7a native c++ sdk
* [cmake] fixed patchelf download on mac and android
* [lite] Add threads and power_mode option support
* [pybind] update runtime pybind for lite power mode
* [python] Add set_lite_power_mode api to runtime
* [Lite] add lite enable_fp16 option support
* [lite] add more options for lite backend.
* [cmake] fixed Paddle Lite typo
* [runtime] format LitePowerMode enum comments
* [runtime] format lite option comments
2022-10-04 17:31:48 +08:00
zhoushunjie
ec8b183d9c
remote HOSTDEVICE modifier
2022-10-02 04:28:30 +00:00
Jack Zhou
dd365fb721
Add trt max workspace setting ( #308 )
...
* add trt max workspace setting
* fix set trt max workspace
2022-09-30 09:54:34 +08:00
DefTruth
c5f85de356
[lite] Add threads and power_mode option support ( #298 )
...
* [cmake] support Android arm64-v8a & armeabi-v7a native c++ sdk
* [cmake] fixed patchelf download on mac and android
* [lite] Add threads and power_mode option support
* [pybind] update runtime pybind for lite power mode
* [python] Add set_lite_power_mode api to runtime
2022-09-28 18:09:35 +08:00
Jason
2d3e61582d
Rename pybind/fastdeploy_runtime.cc to pybind/runtime.cc ( #273 )
...
* fix yaml
* Rename pybind/fastdeploy_runtime.cc to runtime.cc
2022-09-23 11:16:02 +08:00
Jason
e227c5625e
Rename fastdeploy_runtime.h to runtime.h and Frontend to ModelFormat ( #263 )
...
rename frontend to model_format
2022-09-22 13:24:05 +08:00
heliqi
a8e447f225
yolov5 servitization optimization ( #262 )
...
* yolov5 split pre and post process
* yolov5 postprocess
* yolov5 postprocess
2022-09-21 18:22:39 +08:00
Jason
addce837bc
Add paddlelite backend support ( #260 )
...
* Add paddlelite backend support
* Update CMakeLists.txt
* Update __init__.py
2022-09-21 13:22:34 +08:00
Jason
74f1143aba
Support disable logging information ( #254 )
...
* Support disable logging information
* Support disable logging information
2022-09-20 15:44:10 +08:00
Jason
68523be411
Modify file structure to separate python and cpp code ( #223 )
...
Modify code structure
2022-09-14 15:44:13 +08:00
Jason
ffbc5cc42d
Move cpp code to directory csrcs ( #42 )
...
* move cpp code to csrcs
* move cpp code to csrcs
2022-07-26 17:59:02 +08:00
Jason
027f3dd86d
Fix some compile problem in Linux ( #41 )
...
* Add custom operator for onnxruntime ans fix paddle backend
* Polish cmake files and runtime apis
* Remove copy libraries
* fix some issue
* fix bug
* fix bug
* Support remove multiclass_nms to enable paddledetection run tensorrt
* Support remove multiclass_nms to enable paddledetection run tensorrt
* Support remove multiclass_nms to enable paddledetection run tensorrt
* Support remove multiclass_nms to enable paddledetection run tensorrt
* add common operator multiclassnms
* fix compile problem
* fix some compile problem in linux
* remove debug log
Co-authored-by: root <root@bjyz-sys-gpu-kongming3.bjyz.baidu.com >
2022-07-26 16:35:46 +08:00
Jason
279c993483
Polish cmake files and runtime apis ( #36 )
...
* Add custom operator for onnxruntime ans fix paddle backend
* Polish cmake files and runtime apis
* Remove copy libraries
* fix some issue
* fix bug
* fix bug
2022-07-25 08:59:53 +08:00
Jason
f670520bf8
fix some usage problem in linux ( #25 )
...
Co-authored-by: root <root@bjyz-sys-gpu-kongming3.bjyz.baidu.com >
2022-07-19 11:47:13 +08:00
jiangjiajun
6c5bd8afad
fix compile for python
2022-07-13 02:48:08 +00:00
jiangjiajun
4c07d198ba
add model zoo
2022-07-06 03:12:43 +00:00
jiangjiajun
9d87046d78
first commit
2022-07-05 09:30:15 +00:00
