yeliang2258
45865c8724
[Other] Change all XPU to KunlunXin ( #973 )
...
* [FlyCV] Bump up FlyCV -> official release 1.0.0
* XPU to KunlunXin
* update
* update model link
* update doc
* update device
* update code
* useless code
Co-authored-by: DefTruth <qiustudent_r@163.com >
Co-authored-by: DefTruth <31974251+DefTruth@users.noreply.github.com >
2022-12-27 10:02:02 +08:00
yunyaoXYY
d45382e3cc
[Backend] Add Huawei Ascend NPU deploy using PaddleLite CANN. ( #757 )
...
* Add Huawei Ascend NPU deploy through PaddleLite CANN
* Add NNAdapter interface for paddlelite
* Modify Huawei Ascend Cmake
* Update way for compiling Huawei Ascend NPU deployment
* remove UseLiteBackend in UseCANN
* Support compile python whlee
* Change names of nnadapter API
* Add nnadapter pybind and remove useless API
* Support Python deployment on Huawei Ascend NPU
* Add models suppor for ascend
* Add PPOCR rec reszie for ascend
* fix conflict for ascend
* Rename CANN to Ascend
* Rename CANN to Ascend
* Improve ascend
* fix ascend bug
* improve ascend docs
* improve ascend docs
* improve ascend docs
* Improve Ascend
* Improve Ascend
* Move ascend python demo
* Imporve ascend
* Improve ascend
* Improve ascend
* Improve ascend
* Improve ascend
* Imporve ascend
* Imporve ascend
* Improve ascend
2022-12-26 10:18:34 +08:00
Jason
2d998223ac
[Backend] Add KunlunXin XPU deploy support ( #894 )
...
Revert "Revert "[Backend] Add KunlunXin XPU deploy support" (#893 )"
This reverts commit 0990ab9b50
2022-12-16 11:22:30 +08:00
Jason
0990ab9b50
Revert "[Backend] Add KunlunXin XPU deploy support" ( #893 )
...
Revert "[Backend] Add KunlunXin XPU deploy support (#747 )"
This reverts commit 5be839b322
2022-12-15 21:17:59 +08:00
yeliang2258
5be839b322
[Backend] Add KunlunXin XPU deploy support ( #747 )
...
* add xpu support
* fix docs
* update code
* update doc
* update code
* update yolov5
* update cmake
* add int64_t data support
* fix
* update download links
* add en doc
* update code
* update xpu options
* update doc
* update doc
* update doc
* update lib links
* update doc
* update code
* update lite xpu link
* update xpu lib
* update doc
* update en doc
2022-12-15 21:17:14 +08:00
Jason
51818ed825
[Other] Optimize backend selection strategy ( #574 )
...
* Optimize backend selection strategy
* remove debug code
* Update runtime.cc
* Update picodet.cc
* Update yolox.cc
* fix ci
2022-11-13 20:15:20 +08:00
yeliang2258
fa807340be
[Backend] Add Rockchip RV1126 deploy support through PaddleLite TIM-VX ( #439 )
...
* add rk1126 support
* update lib
* fix compile bugs
* update doc
* fix complie bug
* update doc
* update doc
* update code
* support model bigger than 2G
* update code
* update code
* update code
* update doc
* update code
* fix bug
* update code
* update code
* update code
* update doc
* update info
* code style check
* update code
* update doc
Co-authored-by: Jason <jiangjiajun@baidu.com >
2022-11-10 10:05:47 +08:00
WJJ1995
d259952224
[Bug Fix] change reused_input_tensors&&reused_output_tensors name ( #534 )
...
* add paddle_trt in benchmark
* update benchmark in device
* update benchmark
* update result doc
* fixed for CI
* update python api_docs
* update index.rst
* add runtime cpp examples
* deal with comments
* Update infer_paddle_tensorrt.py
* Add runtime quick start
* deal with comments
* fixed reused_input_tensors&&reused_output_tensors
Co-authored-by: Jason <928090362@qq.com >
2022-11-09 00:33:33 +08:00
Wang Xinyu
e5c955dd3e
[Model] yolo use external stream, avoid reallocating output tensors ( #447 )
...
* yolov5 use external stream
* yolov5lite/v6/v7/v7e2etrt: optimize output tensor and cuda stream
* avoid reallocating output tensors
* add input output tensors to FastDeployModel
* add cuda.cmake
* rename to reused_input/output_tensors
* eliminate cmake cuda arch error
* use swap to release input and output tensors
Co-authored-by: Jason <jiangjiajun@baidu.com >
2022-11-02 09:52:27 +08:00
Zheng_Bicheng
4ffcfbe726
[Backend] Add RKNPU2 backend support ( #456 )
...
* 10-29/14:05
* 新增cmake
* 新增rknpu2 backend
* 10-29/14:43
* Runtime fd_type新增RKNPU代码
* 10-29/15:02
* 新增ppseg RKNPU2推理代码
* 10-29/15:46
* 新增ppseg RKNPU2 cpp example代码
* 10-29/15:51
* 新增README文档
* 10-29/15:51
* 按照要求修改部分注释以及变量名称
* 10-29/15:51
* 修复重命名之后，cc文件中的部分代码还用旧函数名的bug
* 10-29/22:32
* str(Device::NPU)将输出NPU而不是UNKOWN
* 修改runtime文件中的注释格式
* 新增Building Summary ENABLE_RKNPU2_BACKEND输出
* pybind新增支持rknpu2
* 新增python编译选项
* 新增PPSeg Python代码
* 新增以及更新各种文档
* 10-30/14:11
* 尝试修复编译cuda时产生的错误
* 10-30/19:27
* 修改CpuName和CoreMask层级
* 修改ppseg rknn推理层级
* 图片将移动到网络进行下载
* 10-30/19:39
* 更新文档
* 10-30/19:39
* 更新文档
* 更新ppseg rknpu2 example中的函数命名方式
* 更新ppseg rknpu2 example为一个cc文件
* 修复disable_normalize_and_permute部分的逻辑错误
* 移除rknpu2初始化时的无用参数
* 10-30/19:39
* 尝试重置python代码
* 10-30/10:16
* rknpu2_config.h文件不再包含rknn_api头文件防止出现导入错误的问题
* 10-31/14:31
* 修改pybind，支持最新的rknpu2 backends
* 再次支持ppseg python推理
* 移动cpuname 和 coremask的层级
* 10-31/15:35
* 尝试修复rknpu2导入错误
* 10-31/19:00
* 新增RKNPU2模型导出代码以及其对应的文档
* 更新大量文档错误
* 10-31/19:00
* 现在编译完fastdeploy仓库后无需重新设置RKNN2_TARGET_SOC
* 10-31/19:26
* 修改部分错误文档
* 10-31/19:26
* 修复错误删除的部分
* 修复各种错误文档
* 修复FastDeploy.cmake在设置RKNN2_TARGET_SOC错误时，提示错误的信息
* 修复rknpu2_backend.cc中存在的中文注释
* 10-31/20:45
* 删除无用的注释
* 10-31/20:45
* 按照要求修改Device::NPU为Device::RKNPU，硬件将共用valid_hardware_backends
* 删除无用注释以及debug代码
* 11-01/09:45
* 更新变量命名方式
* 11-01/10:16
* 修改部分文档，修改函数命名方式
Co-authored-by: Jason <jiangjiajun@baidu.com >
2022-11-01 11:14:05 +08:00
czr-gc
ede59af857
[Backend] support ipu in paddle inference backend. ( #437 )
...
* feat(ipu): add ipu support for paddle_infer backend.
* fix(): remove unused env.
* fix(ipu): simplify user API for IPU.
* fix(cmake): fix merge conflict error in CMakeList.
Co-authored-by: Jason <jiangjiajun@baidu.com >
2022-10-30 18:59:59 +08:00
Wang Xinyu
c8d6c8244e
[Model] Yolov5/v5lite/v6/v7/v7end2end: CUDA preprocessing ( #370 )
...
* add yolo cuda preprocessing
* cmake build cuda src
* yolov5 support cuda preprocessing
* yolov5 cuda preprocessing configurable
* yolov5 update get mat data api
* yolov5 check cuda preprocess args
* refactor cuda function name
* yolo cuda preprocess padding value configurable
* yolov5 release cuda memory
* cuda preprocess pybind api update
* move use_cuda_preprocessing option to yolov5 model
* yolov5lite cuda preprocessing
* yolov6 cuda preprocessing
* yolov7 cuda preprocessing
* yolov7_e2e cuda preprocessing
* remove cuda preprocessing in runtime option
* refine log and cmake variable name
* fix model runtime ptr type
Co-authored-by: Jason <jiangjiajun@baidu.com >
2022-10-19 16:04:58 +08:00
Jason
ecbd78ae58
Remove debug code ( #266 )
...
* Rename Frontend to ModelFormat in documents
* Remove useless debug flag
2022-09-22 15:18:50 +08:00
Jason
addce837bc
Add paddlelite backend support ( #260 )
...
* Add paddlelite backend support
* Update CMakeLists.txt
* Update __init__.py
2022-09-21 13:22:34 +08:00
Jason
74f1143aba
Support disable logging information ( #254 )
...
* Support disable logging information
* Support disable logging information
2022-09-20 15:44:10 +08:00
Jason
68523be411
Modify file structure to separate python and cpp code ( #223 )
...
Modify code structure
2022-09-14 15:44:13 +08:00
Jason
ffbc5cc42d
Move cpp code to directory csrcs ( #42 )
...
* move cpp code to csrcs
* move cpp code to csrcs
2022-07-26 17:59:02 +08:00
Jason
279c993483
Polish cmake files and runtime apis ( #36 )
...
* Add custom operator for onnxruntime ans fix paddle backend
* Polish cmake files and runtime apis
* Remove copy libraries
* fix some issue
* fix bug
* fix bug
2022-07-25 08:59:53 +08:00
Jason
4b681581b1
Add custom operator for onnxruntime and fix paddle backend ( #35 )
...
Add custom operator for onnxruntime ans fix paddle backend
2022-07-23 22:21:36 +08:00
Jason
51ecb407d4
Add Paddle Inference as backend ( #33 )
...
* Add Paddle Inference as backend
* Update CMakeLists.txt
* Fix default backend option
* Fix some log bug and backend choosing strategy
* Add version of g++
2022-07-22 09:53:46 +08:00
jiangjiajun
9d87046d78
first commit
2022-07-05 09:30:15 +00:00
