Commit Graph

474 Commits

Author SHA1 Message Date
Jason
054dfec43a [Other] Remove some build options (#1090)
* remove some flags

* add gpu check in cmake
2023-01-09 17:36:07 +08:00
Jason
4aa4ebd7c3 [Other] [Part2] Upgrade runtime module (#1080)
[Other] Upgrade runtime module
2023-01-09 13:22:51 +08:00
huangjianhui
c8d2fef198 [Bug Fix] When loading model from memory, don't need CheckModelFormat (#1073)
When loading model from memory, don't need CheckModelFormat
2023-01-06 13:48:44 +08:00
Jason
d7a65e5c70 [Other] Upgrade runtime module (#1068)
* Upgrade runtime module

* Update option.h

* Fix build error

* Move enumerates

* little modification

* little modification

* little modification:

* Remove some useless flags
2023-01-06 13:44:05 +08:00
Jason
78a8c9afda [Other] Finetune sophgo module (#1054)
refine sophgo code
2023-01-04 16:18:54 +08:00
Dantès
34bea7649d [Backend] add sophgo backend (#1015)
* Add Sophgo Device

add sophgo backend in fastdeploy

add resnet50, yolov5s, liteseg examples.

* replace sophgo lib with download links; fix model.cc bug

* modify CodeStyle

* remove unuseful files;change the names of sophgo device and sophgo
backend

* sophgo support python and add python examples

* remove unuseful rows in cmake according pr

Co-authored-by: Zilong Xing <zilong.xing@sophgo.com>
2023-01-04 15:49:17 +08:00
Jason
0c292c0766 [Other] Seperate option from backends (#1048)
* Seperate option from backends

* Seperate option from backends

* Seperate option from backends

* Seperate option from backends
2023-01-04 15:06:55 +08:00
totorolin
9b108c3fa5 [Model] Support New PaddleDetection Models (#959)
* Add files via upload

* Add files via upload

* Add files via upload

* Add files via upload

* Add files via upload

* Add files via upload

* Add files via upload

* Add files via upload

* Add files via upload

* Add files via upload

* Add files via upload

* Add files via upload

* Add files via upload

* Add files via upload

Co-authored-by: DefTruth <31974251+DefTruth@users.noreply.github.com>
2023-01-04 10:34:21 +08:00
yunyaoXYY
58d63f3e90 [Other] Add detection, segmentation and OCR examples for Ascend deploy. (#983)
* Add Huawei Ascend NPU deploy through PaddleLite CANN

* Add NNAdapter interface for paddlelite

* Modify Huawei Ascend Cmake

* Update way for compiling Huawei Ascend NPU deployment

* remove UseLiteBackend in UseCANN

* Support compile python whlee

* Change names of nnadapter API

* Add nnadapter pybind and remove useless API

* Support Python deployment on Huawei Ascend NPU

* Add models suppor for ascend

* Add PPOCR rec reszie for ascend

* fix conflict for ascend

* Rename CANN to Ascend

* Rename CANN to Ascend

* Improve ascend

* fix ascend bug

* improve ascend docs

* improve ascend docs

* improve ascend docs

* Improve Ascend

* Improve Ascend

* Move ascend python demo

* Imporve ascend

* Improve ascend

* Improve ascend

* Improve ascend

* Improve ascend

* Imporve ascend

* Imporve ascend

* Improve ascend

* acc eval script

* acc eval

* remove acc_eval from branch huawei

* Add detection and segmentation examples for Ascend deployment

* Add detection and segmentation examples for Ascend deployment

* Add PPOCR example for ascend deploy

* Imporve paddle lite compiliation

* Add FlyCV doc

* Add FlyCV doc

* Add FlyCV doc

* Imporve Ascend docs

* Imporve Ascend docs
2023-01-04 10:01:23 +08:00
Jason
f51697d745 [Other] Optimize code style (#1032)
* Optimize code

* optimize code

* optimize code

* fix compile error
2023-01-03 19:54:12 +08:00
Thomas Young
ab49b41080 add encryption (#1002)
* add encryption

* add doc

* add doc

* fix bug
2023-01-03 15:57:03 +08:00
chenjian
87bcb5df21 [Model] add style transfer model (#922)
* add style transfer model

* add examples for generation model

* add unit test

* add speed comparison

* add speed comparison

* add variable for constant

* add preprocessor and postprocessor

* add preprocessor and postprocessor

* fix

* fix according to review

Co-authored-by: DefTruth <31974251+DefTruth@users.noreply.github.com>
2023-01-03 10:47:08 +08:00
Zheng-Bicheng
d275c3ba02 [Model] Update PPDet Preprocess (#1006)
* 更新导航文档

* 更新导航文档

* 更新导航文档

* 更新导航文档

* 更新PPDet PreProcess

* 更新PPDet PreProcess

* 更新PPDet pybind and python

* 更新

* 更新ppdet
2022-12-29 21:15:23 +08:00
Zheng-Bicheng
dd5759bd99 [Model] Update PPSeg Preprocess (#1007)
* 更新PPSeg pybind and python

* 更新PPSeg pybind and python
2022-12-29 21:14:39 +08:00
Zheng-Bicheng
0401580264 [Bug Fix] Fixed Ppclas Bugs (#1009)
* 更新ppclas

* 更新ppclas

* 更新ppclas

* 更新ppclas
2022-12-29 14:13:55 +08:00
heliqi
ab0929662b [Runtime]FDTensor pybind add from_dlpack interface (#1001)
add from_dlpack
2022-12-28 21:58:32 +08:00
舞影凌风
973c746d06 [RKNPU2]support rknpu2 ClasModel #957 (#964)
* [RKNPU2]support rknpu2 ClasModel #957

* [RKNPU2]support rknpu2 ClasModel #957

* [RKNPU2]support rknpu2 add Resnet50_vd example  #957

* [RKNPU2]support rknpu2 add Resnet50_vd example  #957

* [RKNPU2]support rknpu2, improve doc  #957

* [RKNPU2]support rknpu2, improve doc  #957

* [RKNPU2]support rknpu2, improve doc  #957

* [RKNPU2]support rknpu2, improve doc  #957

* [RKNPU2]support rknpu2, improve doc  #957

* [RKNPU2]support rknpu2, improve doc  #957

* [RKNPU2]support rknpu2, improve doc  #957
2022-12-28 17:58:18 +08:00
Jack Zhou
a906ddd8ea Merge branch 'develop' into add_batch_size_for_uie 2022-12-28 10:51:40 +08:00
guxukai
866d044898 [Model] add detection model : FastestDet (#842)
* model done, CLA fix

* remove letter_box and ConvertAndPermute, use resize hwc2chw and convert in preprocess

* remove useless values in preprocess

* remove useless values in preprocess

* fix reviewed problem

* fix reviewed problem pybind

* fix reviewed problem pybind

* postprocess fix

* add test_fastestdet.py, coco_val2017_500 fixed done, ready to review

* fix reviewed problem

* python/.../fastestdet.py

* fix infer.cc, preprocess, python/fastestdet.py

* fix examples/python/infer.py
2022-12-28 10:49:17 +08:00
zhoushunjie
cfac517ef3 fix for 2022-12-27 15:34:18 +00:00
zhoushunjie
60f8f0e11b Add batch size argument for uie 2022-12-27 15:22:09 +00:00
Jack Zhou
3c38ba4415 [FDTensor] Add device id to output tensor (#978)
Add device id
2022-12-27 16:02:57 +08:00
yeliang2258
45865c8724 [Other] Change all XPU to KunlunXin (#973)
* [FlyCV] Bump up FlyCV -> official release 1.0.0

* XPU to KunlunXin

* update

* update model link

* update doc

* update device

* update code

* useless code

Co-authored-by: DefTruth <qiustudent_r@163.com>
Co-authored-by: DefTruth <31974251+DefTruth@users.noreply.github.com>
2022-12-27 10:02:02 +08:00
Zheng_Bicheng
ec67f8ee6d [Model] Refactor insightface models (#919)
* 重构insightface代码

* 重写insightface example代码

* 重写insightface example代码

* 删除多余代码

* 修改预处理代码

* 修改文档

* 修改文档

* 恢复误删除的文件

* 修改cpp example

* 修改cpp example

* 测试python代码

* 测试python代码

* 测试python代码

* 测试python代码

* 测试python代码

* 测试python代码

* 测试python代码

* 跑通python代码

* 修复重复初始化的bug

* 更新adaface的python代码

* 修复c++重复初始化的问题

* 修复c++重复初始化的问题

* 修复Python重复初始化的问题

* 新增preprocess的几个参数的获取方式

* 修复注释的错误

* 按照要求修改

* 修改文档中的图片为图片压缩包

* 修改编译完成后程序的提示

* 更新错误include

* 删除无用文件

* 更新文档
2022-12-26 21:01:58 +08:00
yeliang2258
1911002b90 [Backend]Add stable_diffusion and detection models support for KunlunXin XPU (#954)
* [FlyCV] Bump up FlyCV -> official release 1.0.0

* add valid_xpu for detection

* add paddledetection model support for xpu

* support all detection model in c++ and python

* fix code

* add python stable_diffusion support

Co-authored-by: DefTruth <qiustudent_r@163.com>
Co-authored-by: DefTruth <31974251+DefTruth@users.noreply.github.com>
2022-12-26 16:22:52 +08:00
yeliang2258
7b15f72516 [Backend] Add OCR、Seg、 KeypointDetection、Matting、 ernie-3.0 and adaface models for XPU Deploy (#960)
* [FlyCV] Bump up FlyCV -> official release 1.0.0

* add seg models for XPU

* add ocr model for XPU

* add matting

* add matting python

* fix infer.cc

* add keypointdetection support for XPU

* Add adaface support for XPU

* add ernie-3.0

* fix doc

Co-authored-by: DefTruth <qiustudent_r@163.com>
Co-authored-by: DefTruth <31974251+DefTruth@users.noreply.github.com>
2022-12-26 15:02:58 +08:00
yunyaoXYY
d45382e3cc [Backend] Add Huawei Ascend NPU deploy using PaddleLite CANN. (#757)
* Add Huawei Ascend NPU deploy through PaddleLite CANN

* Add NNAdapter interface for paddlelite

* Modify Huawei Ascend Cmake

* Update way for compiling Huawei Ascend NPU deployment

* remove UseLiteBackend in UseCANN

* Support compile python whlee

* Change names of nnadapter API

* Add nnadapter pybind and remove useless API

* Support Python deployment on Huawei Ascend NPU

* Add models suppor for ascend

* Add PPOCR rec reszie for ascend

* fix conflict for ascend

* Rename CANN to Ascend

* Rename CANN to Ascend

* Improve ascend

* fix ascend bug

* improve ascend docs

* improve ascend docs

* improve ascend docs

* Improve Ascend

* Improve Ascend

* Move ascend python demo

* Imporve ascend

* Improve ascend

* Improve ascend

* Improve ascend

* Improve ascend

* Imporve ascend

* Imporve ascend

* Improve ascend
2022-12-26 10:18:34 +08:00
CoolCola
2431890f73 [Model]Fit yolov7face file path (#961)
fit yolov7face file path
2022-12-25 16:30:03 +08:00
WJJ1995
0f28f9432f [Model] Add is_mini_pad and stride for YOLOv5 python (#949)
* add onnx_ort_runtime demo

* rm in requirements

* support batch eval

* fixed MattingResults bug

* move assignment for DetectionResult

* integrated x2paddle

* add model convert readme

* update readme

* re-lint

* add processor api

* Add MattingResult Free

* change valid_cpu_backends order

* add ppocr benchmark

* mv bs from 64 to 32

* fixed quantize.md

* fixed quantize bugs

* Add Monitor for benchmark

* update mem monitor

* Set trt_max_batch_size default 1

* fixed ocr benchmark bug

* support yolov5 in serving

* Fixed yolov5 serving

* Fixed postprocess

* update yolov5 to 7.0

* add poros runtime demos

* update readme

* Support poros abi=1

* rm useless note

* deal with comments

* support pp_trt for ppseg

* fixed symlink problem

* Add is_mini_pad and stride for yolov5

Co-authored-by: Jason <jiangjiajun@baidu.com>
2022-12-22 19:15:32 +08:00
huangjianhui
60b84ef315 [Other] Add comments for swap_background api (#941)
* Update keypointdetection result docs

* Update im.copy() to im in examples

* Update new Api, fastdeploy::vision::Visualize to fastdeploy::vision

* Update SwapBackgroundSegmentation && SwapBackgroundMatting to SwapBackground

* Update README_CN.md

* Update README_CN.md

* Add comments for swap_background Api
2022-12-22 10:14:36 +08:00
yunyaoXYY
f24bf9523e [Bug Fix] Fix PPOCR rec model bug. (#935)
* Fix links in readme

* Fix links in readme

* Update PPOCRv2/v3 examples

* Update auto compression configs

* Add neww quantization  support for paddleclas model

* Update quantized Yolov6s model download link

* Improve PPOCR comments

* Add English doc for quantization

* Fix PPOCR rec model bug
2022-12-21 18:31:09 +08:00
huangjianhui
291db315c8 [Other]Fastdeploy supports set_model_buffer function for encrypted model (#930)
* Update keypointdetection result docs

* Update im.copy() to im in examples

* Update new Api, fastdeploy::vision::Visualize to fastdeploy::vision

* Update SwapBackgroundSegmentation && SwapBackgroundMatting to SwapBackground

* Update README_CN.md

* Update README_CN.md

* Support set_model_buffer function
2022-12-21 14:21:28 +08:00
yeliang2258
b42ec302e6 [Doc] Change all PaddleLite or Paddle-Lite to Paddle Lite (#929)
* [FlyCV] Bump up FlyCV -> official release 1.0.0

* change PaddleLite or Paddle-Lite to Paddle lite

* fix docs

* fix doc

Co-authored-by: DefTruth <qiustudent_r@163.com>
Co-authored-by: DefTruth <31974251+DefTruth@users.noreply.github.com>
2022-12-21 14:15:50 +08:00
DefTruth
725fe52df3 [FlyCV] Bump up FlyCV -> official release 1.0.0 (#916) 2022-12-21 10:36:07 +08:00
DefTruth
42f9d54749 [ARM] refactor VisSegmentation neon & add SwapBackground neon (#907)
* [ARM] refactor VisSegmentation neon & add SwapBackground neon

* [ARM] refactor VisSegmentation neon & add SwapBackground neon

* [ARM] Add SwapBackground neon for matting

* [ARM] Add SwapBackground neon for seg

* [ARM] Add SwapBackground neon for seg

* [Bug Fix] Add SwapBackground neon for seg
2022-12-19 20:30:13 +08:00
Zheng_Bicheng
218f33f8b1 [RKNPU2] Add Quantized PPHumanSeg (#905)
* 更新rknpu2 backend核心代码

* 更新模型导出核心代码

* 删除无用的config文件

* 新增配置文件以及修改文档

* 模型转换以及文档

* 更新文档

* 更新与配置文件

* 更新PPHumanSeg全量化

* 更新文档

* 更新文档

* 更新文档
2022-12-19 20:07:32 +08:00
Zheng_Bicheng
dc13eb7049 [RKNPU2] Update quantitative model (#879)
* 对RKNPU2后端进行修改,当模型为非量化模型时,不在NPU执行normalize操作,当模型为量化模型时,在NUP上执行normalize操作

* 更新RKNPU2框架,输出数据的数据类型统一返回fp32类型

* 更新scrfd,拆分disable_normalize和disable_permute

* 更新scrfd代码,支持量化

* 更新scrfd python example代码

* 更新模型转换代码,支持量化模型

* 更新文档

* 按照要求修改

* 按照要求修改

* 修正模型转换文档

* 更新一下转换脚本
2022-12-19 13:58:43 +08:00
Zheng_Bicheng
95beb2bbf6 [RKNPU2] RKYOLO Support FP32 return value (#898)
* RKNPU2 Backend兼容其他模型的量化
fd_tensor正式移除zp和scale的量化参数

* 更新FP32返回值的RKYOLO

* 更新rkyolov5支持fp32格式

* 更新rkyolov5支持fp32格式

* 更新YOLOv5速度文档

Co-authored-by: DefTruth <31974251+DefTruth@users.noreply.github.com>
2022-12-19 10:03:18 +08:00
DefTruth
6060f4060b [Bug Fix] fix lite int64 datatype convert (#892)
Co-authored-by: Jason <jiangjiajun@baidu.com>
2022-12-16 13:29:56 +08:00
Jason
2d998223ac [Backend] Add KunlunXin XPU deploy support (#894)
Revert "Revert "[Backend] Add KunlunXin XPU deploy support" (#893)"

This reverts commit 0990ab9b50.
2022-12-16 11:22:30 +08:00
Jason
0990ab9b50 Revert "[Backend] Add KunlunXin XPU deploy support" (#893)
Revert "[Backend] Add KunlunXin XPU deploy support (#747)"

This reverts commit 5be839b322.
2022-12-15 21:17:59 +08:00
yeliang2258
5be839b322 [Backend] Add KunlunXin XPU deploy support (#747)
* add xpu support

* fix docs

* update code

* update doc

* update code

* update yolov5

* update cmake

* add int64_t data support

* fix

* update download links

* add en doc

* update code

* update xpu options

* update doc

* update doc

* update doc

* update lib links

* update doc

* update code

* update lite xpu link

* update xpu lib

* update doc

* update en doc
2022-12-15 21:17:14 +08:00
totorolin
3164af65a4 [Model] Support PaddleYOLO YOLOv5 YOLOv6 YOLOv7 RTMDet models (#857)
* Add files via upload

* Add files via upload

* Add files via upload

* Add files via upload

* Add files via upload

* Add files via upload

* Add files via upload

* Add files via upload

* Add files via upload

* Add files via upload

* Add files via upload

* Add files via upload

* Add files via upload

* Add files via upload

* Add files via upload

* Add files via upload

Co-authored-by: DefTruth <31974251+DefTruth@users.noreply.github.com>
2022-12-15 11:46:13 +08:00
huangjianhui
ada54bfd47 [Other]Update python && cpp multi_thread examples (#876)
* Refactor PaddleSeg with preprocessor && postprocessor

* Fix bugs

* Delete redundancy code

* Modify by comments

* Refactor according to comments

* Add batch evaluation

* Add single test script

* Add ppliteseg single test script && fix eval(raise) error

* fix bug

* Fix evaluation segmentation.py batch predict

* Fix segmentation evaluation bug

* Fix evaluation segmentation bugs

* Update segmentation result docs

* Update old predict api and DisableNormalizeAndPermute

* Update resize segmentation label map with cv::INTER_NEAREST

* Add Model Clone function for PaddleClas && PaddleDet && PaddleSeg

* Add multi thread demo

* Add python model clone function

* Add multi thread python && C++ example

* Fix bug

* Update python && cpp multi_thread examples

* Add cpp && python directory

* Add README.md for examples

* Delete redundant code

Co-authored-by: Jason <jiangjiajun@baidu.com>
2022-12-14 19:18:53 +08:00
CoolCola
ce4867d14e [Model] Support YOLOv7-face Model (#651)
* 测试

* delete test

* add yolov7-face

* fit vision.h

* add yolov7-face test

* fit: yolov7-face infer.cc

* fit

* fit Yolov7-face Cmakelist

* fit yolov7Face.cc

* add yolov7-face pybind

* add yolov7-face python infer

* feat yolov7-face pybind

* feat yolov7-face format error

* feat yolov7face_pybind error

* feat add yolov7face-pybind to facedet-pybind

* same as before

* same sa before

* feat __init__.py

* add yolov7face.py

* feat yolov7face.h ignore ","

* feat .py

* fit yolov7face.py

* add yolov7face test teadme file

* add test file

* fit postprocess

* delete remain annotation

* fit preview

* fit yolov7facepreprocessor

* fomat code

* fomat code

* fomat code

* fit format error and confthreshold and nmsthres

* fit confthreshold and nmsthres

* fit test-yolov7-face

* fit test_yolov7face

* fit review

* fit ci error

Co-authored-by: kongbohua <kongbh2022@stu.pku.edu.cn>
Co-authored-by: CoolCola <49013063+kongbohua@users.noreply.github.com>
2022-12-14 19:14:43 +08:00
yunyaoXYY
f601d076e4 [Other] Improve some PPOCR API comments. (#875)
* Fix links in readme

* Fix links in readme

* Update PPOCRv2/v3 examples

* Update auto compression configs

* Add neww quantization  support for paddleclas model

* Update quantized Yolov6s model download link

* Improve PPOCR comments
2022-12-14 10:08:31 +08:00
huangjianhui
9937b6c325 [Other] Add Model Clone function for PaddleClas && PaddleDet && PaddleSeg (#791)
* Refactor PaddleSeg with preprocessor && postprocessor

* Fix bugs

* Delete redundancy code

* Modify by comments

* Refactor according to comments

* Add batch evaluation

* Add single test script

* Add ppliteseg single test script && fix eval(raise) error

* fix bug

* Fix evaluation segmentation.py batch predict

* Fix segmentation evaluation bug

* Fix evaluation segmentation bugs

* Update segmentation result docs

* Update old predict api and DisableNormalizeAndPermute

* Update resize segmentation label map with cv::INTER_NEAREST

* Add Model Clone function for PaddleClas && PaddleDet && PaddleSeg

* Add multi thread demo

* Add python model clone function

* Add multi thread python && C++ example

* Fix bug

Co-authored-by: Jason <jiangjiajun@baidu.com>
2022-12-13 15:19:47 +08:00
yeliang2258
6a1a3d001f [Backend] A311D support (#825)
* add A311D support

* update code

* update toolchain

* update opencv_armhf lib

* update libs

* update code

* add install script

* update bos link

* update toolchain
2022-12-13 11:53:36 +08:00
Zheng_Bicheng
188dcedc02 [RKNN2] Fix bugs (#851)
* 修复picodet格式

* * 修正错误文档
* 修复rknpu2 backend后端的部分错误
* 更新pphumanseg example格式

* * 更新pphumanseg example格式

* * 更新picodet example格式

* * 更新scrfd example格式

* * 更新ppseg rknpu2 python example中的错误

* * 修复代码格式问题

* * 修复代码格式问题

* * 修复代码格式问题

* * 修复代码格式问题

* * 修复代码格式问题

* * 修复代码格式问题

Co-authored-by: Jason <jiangjiajun@baidu.com>
2022-12-12 15:37:31 +08:00
DefTruth
5b54bcfb48 [ARM] fix VisSegmentation background error with bit ops (#852)
* [NEON] fix visseg background error with bit ops

* [Bug Fix] fix build_android_aar.sh ci scripts

* [Bug Fix] fix VisSegmentationCommonCpu
2022-12-12 09:54:08 +08:00