apps/FastDeploy
1
0
Fork 0
mirror of https://github.com/PaddlePaddle/FastDeploy.git synced 2025-10-13 04:13:58 +08:00
Code Issues Actions 2 Packages Projects Releases Wiki Activity
2,417 Commits 16 Branches 8 Tags
75b0d3498b51d0cec7bc8ab9bcbb9ccc19549eda
Commit Graph

532 Commits

Author SHA1 Message Date
Jason
d00df3d621 [Backend] Remove all lite options in RuntimeOption (#1109) 
* Remove all lite options in RuntimeOption

* Fix code error

* move pybind

* Fix build error
 2023-01-13 19:40:34 +08:00
Jack Zhou
f861095a53 [Functions] Fix functions comments (#1126) 
* fix functions comments

* Add paddle lite backend
 2023-01-12 18:57:24 +08:00
WJJ1995
aa6931bee9 [Model] Add YOLOv5-seg (#988) 
* add onnx_ort_runtime demo

* rm in requirements

* support batch eval

* fixed MattingResults bug

* move assignment for DetectionResult

* integrated x2paddle

* add model convert readme

* update readme

* re-lint

* add processor api

* Add MattingResult Free

* change valid_cpu_backends order

* add ppocr benchmark

* mv bs from 64 to 32

* fixed quantize.md

* fixed quantize bugs

* Add Monitor for benchmark

* update mem monitor

* Set trt_max_batch_size default 1

* fixed ocr benchmark bug

* support yolov5 in serving

* Fixed yolov5 serving

* Fixed postprocess

* update yolov5 to 7.0

* add poros runtime demos

* update readme

* Support poros abi=1

* rm useless note

* deal with comments

* support pp_trt for ppseg

* fixed symlink problem

* Add is_mini_pad and stride for yolov5

* Add yolo series for paddle format

* fixed bugs

* fixed bug

* support yolov5seg

* fixed bug

* refactor yolov5seg

* fixed bug

* mv Mask int32 to uint8

* add yolov5seg example

* rm log info

* fixed code style

* add yolov5seg example in python

* fixed dtype bug

* update note

* deal with comments

* get sorted index

* add yolov5seg test case

* Add GPL-3.0 License

* add round func

* deal with comments

* deal with commens

Co-authored-by: Jason <jiangjiajun@baidu.com>
 2023-01-11 15:36:32 +08:00
Jack Zhou
60e6a12b93 [Bug Fix] Fix verbose (#1112) 
fix verbose

Co-authored-by: Jason <jiangjiajun@baidu.com>
 2023-01-11 13:56:51 +08:00
Dantès
de70e8366c add ocr, ppyoloe, picodet examples (#1076) 
* add ocr examples

* add ppyoloe examples

add picodet examples

* remove /ScaleFactor in ppdet/postprocessor.cc
 2023-01-10 16:34:26 +08:00
Jason
fc314f1696 [Other] Rename directory op_cuda_kernels to common/cuda (#1104) 
rename directory name
 2023-01-10 16:31:37 +08:00
heliqi
7fdbedcc99 [Bug Fix]The TRT Backend Clone Interface is restored to Runtime.Init (#1101) 
Update runtime.cc
 2023-01-10 10:32:07 +08:00
Jason
df20b2a02b [Other] Remove useless macros (#1095) 
* Remove useless macros

* triger ci

* fix check error

* rename INTEGRATE_PADDLE2ONNX to ENABLE_PADDLE2ONNX
 2023-01-09 21:35:23 +08:00
Jason
054dfec43a [Other] Remove some build options (#1090) 
* remove some flags

* add gpu check in cmake
 2023-01-09 17:36:07 +08:00
Jason
4aa4ebd7c3 [Other] [Part2] Upgrade runtime module (#1080) 
[Other] Upgrade runtime module
 2023-01-09 13:22:51 +08:00
huangjianhui
c8d2fef198 [Bug Fix] When loading model from memory, don't need CheckModelFormat (#1073) 
When loading model from memory, don't need CheckModelFormat
 2023-01-06 13:48:44 +08:00
Jason
d7a65e5c70 [Other] Upgrade runtime module (#1068) 
* Upgrade runtime module

* Update option.h

* Fix build error

* Move enumerates

* little modification

* little modification

* little modification:

* Remove some useless flags
 2023-01-06 13:44:05 +08:00
Jason
78a8c9afda [Other] Finetune sophgo module (#1054) 
refine sophgo code
 2023-01-04 16:18:54 +08:00
Dantès
34bea7649d [Backend] add sophgo backend (#1015) 
* Add Sophgo Device

add sophgo backend in fastdeploy

add resnet50, yolov5s, liteseg examples.

* replace sophgo lib with download links; fix model.cc bug

* modify CodeStyle

* remove unuseful files;change the names of sophgo device and sophgo
backend

* sophgo support python and add python examples

* remove unuseful rows in cmake according pr

Co-authored-by: Zilong Xing <zilong.xing@sophgo.com>
 2023-01-04 15:49:17 +08:00
Jason
0c292c0766 [Other] Seperate option from backends (#1048) 
* Seperate option from backends

* Seperate option from backends

* Seperate option from backends

* Seperate option from backends
 2023-01-04 15:06:55 +08:00
totorolin
9b108c3fa5 [Model] Support New PaddleDetection Models (#959) 
* Add files via upload

* Add files via upload

* Add files via upload

* Add files via upload

* Add files via upload

* Add files via upload

* Add files via upload

* Add files via upload

* Add files via upload

* Add files via upload

* Add files via upload

* Add files via upload

* Add files via upload

* Add files via upload

Co-authored-by: DefTruth <31974251+DefTruth@users.noreply.github.com>
 2023-01-04 10:34:21 +08:00
yunyaoXYY
58d63f3e90 [Other] Add detection, segmentation and OCR examples for Ascend deploy. (#983) 
* Add Huawei Ascend NPU deploy through PaddleLite CANN

* Add NNAdapter interface for paddlelite

* Modify Huawei Ascend Cmake

* Update way for compiling Huawei Ascend NPU deployment

* remove UseLiteBackend in UseCANN

* Support compile python whlee

* Change names of nnadapter API

* Add nnadapter pybind and remove useless API

* Support Python deployment on Huawei Ascend NPU

* Add models suppor for ascend

* Add PPOCR rec reszie for ascend

* fix conflict for ascend

* Rename CANN to Ascend

* Rename CANN to Ascend

* Improve ascend

* fix ascend bug

* improve ascend docs

* improve ascend docs

* improve ascend docs

* Improve Ascend

* Improve Ascend

* Move ascend python demo

* Imporve ascend

* Improve ascend

* Improve ascend

* Improve ascend

* Improve ascend

* Imporve ascend

* Imporve ascend

* Improve ascend

* acc eval script

* acc eval

* remove acc_eval from branch huawei

* Add detection and segmentation examples for Ascend deployment

* Add detection and segmentation examples for Ascend deployment

* Add PPOCR example for ascend deploy

* Imporve paddle lite compiliation

* Add FlyCV doc

* Add FlyCV doc

* Add FlyCV doc

* Imporve Ascend docs

* Imporve Ascend docs
 2023-01-04 10:01:23 +08:00
Jason
f51697d745 [Other] Optimize code style (#1032) 
* Optimize code

* optimize code

* optimize code

* fix compile error
 2023-01-03 19:54:12 +08:00
Thomas Young
ab49b41080 add encryption (#1002) 
* add encryption

* add doc

* add doc

* fix bug
 2023-01-03 15:57:03 +08:00
chenjian
87bcb5df21 [Model] add style transfer model (#922) 
* add style transfer model

* add examples for generation model

* add unit test

* add speed comparison

* add speed comparison

* add variable for constant

* add preprocessor and postprocessor

* add preprocessor and postprocessor

* fix

* fix according to review

Co-authored-by: DefTruth <31974251+DefTruth@users.noreply.github.com>
 2023-01-03 10:47:08 +08:00
Zheng-Bicheng
d275c3ba02 [Model] Update PPDet Preprocess (#1006) 
* 更新导航文档

* 更新导航文档

* 更新导航文档

* 更新导航文档

* 更新PPDet PreProcess

* 更新PPDet PreProcess

* 更新PPDet pybind and python

* 更新

* 更新ppdet
 2022-12-29 21:15:23 +08:00
Zheng-Bicheng
dd5759bd99 [Model] Update PPSeg Preprocess (#1007) 
* 更新PPSeg pybind and python

* 更新PPSeg pybind and python
 2022-12-29 21:14:39 +08:00
Zheng-Bicheng
0401580264 [Bug Fix] Fixed Ppclas Bugs (#1009) 
* 更新ppclas

* 更新ppclas

* 更新ppclas

* 更新ppclas
 2022-12-29 14:13:55 +08:00
heliqi
ab0929662b [Runtime]FDTensor pybind add from_dlpack interface (#1001) 
add from_dlpack
 2022-12-28 21:58:32 +08:00
舞影凌风
973c746d06 [RKNPU2]support rknpu2 ClasModel #957 (#964) 
* [RKNPU2]support rknpu2 ClasModel #957

* [RKNPU2]support rknpu2 ClasModel #957

* [RKNPU2]support rknpu2 add Resnet50_vd example  #957

* [RKNPU2]support rknpu2 add Resnet50_vd example  #957

* [RKNPU2]support rknpu2, improve doc  #957

* [RKNPU2]support rknpu2, improve doc  #957

* [RKNPU2]support rknpu2, improve doc  #957

* [RKNPU2]support rknpu2, improve doc  #957

* [RKNPU2]support rknpu2, improve doc  #957

* [RKNPU2]support rknpu2, improve doc  #957

* [RKNPU2]support rknpu2, improve doc  #957
 2022-12-28 17:58:18 +08:00
Jack Zhou
a906ddd8ea Merge branch 'develop' into add_batch_size_for_uie 2022-12-28 10:51:40 +08:00
guxukai
866d044898 [Model] add detection model : FastestDet (#842) 
* model done, CLA fix

* remove letter_box and ConvertAndPermute, use resize hwc2chw and convert in preprocess

* remove useless values in preprocess

* remove useless values in preprocess

* fix reviewed problem

* fix reviewed problem pybind

* fix reviewed problem pybind

* postprocess fix

* add test_fastestdet.py, coco_val2017_500 fixed done, ready to review

* fix reviewed problem

* python/.../fastestdet.py

* fix infer.cc, preprocess, python/fastestdet.py

* fix examples/python/infer.py
 2022-12-28 10:49:17 +08:00
zhoushunjie
cfac517ef3 fix for 2022-12-27 15:34:18 +00:00
zhoushunjie
60f8f0e11b Add batch size argument for uie 2022-12-27 15:22:09 +00:00
Jack Zhou
3c38ba4415 [FDTensor] Add device id to output tensor (#978) 
Add device id
 2022-12-27 16:02:57 +08:00
yeliang2258
45865c8724 [Other] Change all XPU to KunlunXin (#973) 
* [FlyCV] Bump up FlyCV -> official release 1.0.0

* XPU to KunlunXin

* update

* update model link

* update doc

* update device

* update code

* useless code

Co-authored-by: DefTruth <qiustudent_r@163.com>
Co-authored-by: DefTruth <31974251+DefTruth@users.noreply.github.com>
 2022-12-27 10:02:02 +08:00
Zheng_Bicheng
ec67f8ee6d [Model] Refactor insightface models (#919) 
* 重构insightface代码

* 重写insightface example代码

* 重写insightface example代码

* 删除多余代码

* 修改预处理代码

* 修改文档

* 修改文档

* 恢复误删除的文件

* 修改cpp example

* 修改cpp example

* 测试python代码

* 测试python代码

* 测试python代码

* 测试python代码

* 测试python代码

* 测试python代码

* 测试python代码

* 跑通python代码

* 修复重复初始化的bug

* 更新adaface的python代码

* 修复c++重复初始化的问题

* 修复c++重复初始化的问题

* 修复Python重复初始化的问题

* 新增preprocess的几个参数的获取方式

* 修复注释的错误

* 按照要求修改

* 修改文档中的图片为图片压缩包

* 修改编译完成后程序的提示

* 更新错误include

* 删除无用文件

* 更新文档
 2022-12-26 21:01:58 +08:00
yeliang2258
1911002b90 [Backend]Add stable_diffusion and detection models support for KunlunXin XPU (#954) 
* [FlyCV] Bump up FlyCV -> official release 1.0.0

* add valid_xpu for detection

* add paddledetection model support for xpu

* support all detection model in c++ and python

* fix code

* add python stable_diffusion support

Co-authored-by: DefTruth <qiustudent_r@163.com>
Co-authored-by: DefTruth <31974251+DefTruth@users.noreply.github.com>
 2022-12-26 16:22:52 +08:00
yeliang2258
7b15f72516 [Backend] Add OCR、Seg、 KeypointDetection、Matting、 ernie-3.0 and adaface models for XPU Deploy (#960) 
* [FlyCV] Bump up FlyCV -> official release 1.0.0

* add seg models for XPU

* add ocr model for XPU

* add matting

* add matting python

* fix infer.cc

* add keypointdetection support for XPU

* Add adaface support for XPU

* add ernie-3.0

* fix doc

Co-authored-by: DefTruth <qiustudent_r@163.com>
Co-authored-by: DefTruth <31974251+DefTruth@users.noreply.github.com>
 2022-12-26 15:02:58 +08:00
yunyaoXYY
d45382e3cc [Backend] Add Huawei Ascend NPU deploy using PaddleLite CANN. (#757) 
* Add Huawei Ascend NPU deploy through PaddleLite CANN

* Add NNAdapter interface for paddlelite

* Modify Huawei Ascend Cmake

* Update way for compiling Huawei Ascend NPU deployment

* remove UseLiteBackend in UseCANN

* Support compile python whlee

* Change names of nnadapter API

* Add nnadapter pybind and remove useless API

* Support Python deployment on Huawei Ascend NPU

* Add models suppor for ascend

* Add PPOCR rec reszie for ascend

* fix conflict for ascend

* Rename CANN to Ascend

* Rename CANN to Ascend

* Improve ascend

* fix ascend bug

* improve ascend docs

* improve ascend docs

* improve ascend docs

* Improve Ascend

* Improve Ascend

* Move ascend python demo

* Imporve ascend

* Improve ascend

* Improve ascend

* Improve ascend

* Improve ascend

* Imporve ascend

* Imporve ascend

* Improve ascend
 2022-12-26 10:18:34 +08:00
CoolCola
2431890f73 [Model]Fit yolov7face file path (#961) 
fit yolov7face file path
 2022-12-25 16:30:03 +08:00
WJJ1995
0f28f9432f [Model] Add is_mini_pad and stride for YOLOv5 python (#949) 
* add onnx_ort_runtime demo

* rm in requirements

* support batch eval

* fixed MattingResults bug

* move assignment for DetectionResult

* integrated x2paddle

* add model convert readme

* update readme

* re-lint

* add processor api

* Add MattingResult Free

* change valid_cpu_backends order

* add ppocr benchmark

* mv bs from 64 to 32

* fixed quantize.md

* fixed quantize bugs

* Add Monitor for benchmark

* update mem monitor

* Set trt_max_batch_size default 1

* fixed ocr benchmark bug

* support yolov5 in serving

* Fixed yolov5 serving

* Fixed postprocess

* update yolov5 to 7.0

* add poros runtime demos

* update readme

* Support poros abi=1

* rm useless note

* deal with comments

* support pp_trt for ppseg

* fixed symlink problem

* Add is_mini_pad and stride for yolov5

Co-authored-by: Jason <jiangjiajun@baidu.com>
 2022-12-22 19:15:32 +08:00
huangjianhui
60b84ef315 [Other] Add comments for swap_background api (#941) 
* Update keypointdetection result docs

* Update im.copy() to im in examples

* Update new Api, fastdeploy::vision::Visualize to fastdeploy::vision

* Update SwapBackgroundSegmentation && SwapBackgroundMatting to SwapBackground

* Update README_CN.md

* Update README_CN.md

* Add comments for swap_background Api
 2022-12-22 10:14:36 +08:00
yunyaoXYY
f24bf9523e [Bug Fix] Fix PPOCR rec model bug. (#935) 
* Fix links in readme

* Fix links in readme

* Update PPOCRv2/v3 examples

* Update auto compression configs

* Add neww quantization  support for paddleclas model

* Update quantized Yolov6s model download link

* Improve PPOCR comments

* Add English doc for quantization

* Fix PPOCR rec model bug
 2022-12-21 18:31:09 +08:00
huangjianhui
291db315c8 [Other]Fastdeploy supports set_model_buffer function for encrypted model (#930) 
* Update keypointdetection result docs

* Update im.copy() to im in examples

* Update new Api, fastdeploy::vision::Visualize to fastdeploy::vision

* Update SwapBackgroundSegmentation && SwapBackgroundMatting to SwapBackground

* Update README_CN.md

* Update README_CN.md

* Support set_model_buffer function
 2022-12-21 14:21:28 +08:00
yeliang2258
b42ec302e6 [Doc] Change all PaddleLite or Paddle-Lite to Paddle Lite (#929) 
* [FlyCV] Bump up FlyCV -> official release 1.0.0

* change PaddleLite or Paddle-Lite to Paddle lite

* fix docs

* fix doc

Co-authored-by: DefTruth <qiustudent_r@163.com>
Co-authored-by: DefTruth <31974251+DefTruth@users.noreply.github.com>
 2022-12-21 14:15:50 +08:00
DefTruth
725fe52df3 [FlyCV] Bump up FlyCV -> official release 1.0.0 (#916) 2022-12-21 10:36:07 +08:00
DefTruth
42f9d54749 [ARM] refactor VisSegmentation neon & add SwapBackground neon (#907) 
* [ARM] refactor VisSegmentation neon & add SwapBackground neon

* [ARM] refactor VisSegmentation neon & add SwapBackground neon

* [ARM] Add SwapBackground neon for matting

* [ARM] Add SwapBackground neon for seg

* [ARM] Add SwapBackground neon for seg

* [Bug Fix] Add SwapBackground neon for seg
 2022-12-19 20:30:13 +08:00
Zheng_Bicheng
218f33f8b1 [RKNPU2] Add Quantized PPHumanSeg (#905) 
* 更新rknpu2 backend核心代码

* 更新模型导出核心代码

* 删除无用的config文件

* 新增配置文件以及修改文档

* 模型转换以及文档

* 更新文档

* 更新与配置文件

* 更新PPHumanSeg全量化

* 更新文档

* 更新文档

* 更新文档
 2022-12-19 20:07:32 +08:00
Zheng_Bicheng
dc13eb7049 [RKNPU2] Update quantitative model (#879) 
* 对RKNPU2后端进行修改，当模型为非量化模型时，不在NPU执行normalize操作，当模型为量化模型时，在NUP上执行normalize操作

* 更新RKNPU2框架，输出数据的数据类型统一返回fp32类型

* 更新scrfd，拆分disable_normalize和disable_permute

* 更新scrfd代码，支持量化

* 更新scrfd python example代码

* 更新模型转换代码，支持量化模型

* 更新文档

* 按照要求修改

* 按照要求修改

* 修正模型转换文档

* 更新一下转换脚本
 2022-12-19 13:58:43 +08:00
Zheng_Bicheng
95beb2bbf6 [RKNPU2] RKYOLO Support FP32 return value (#898) 
* RKNPU2 Backend兼容其他模型的量化
fd_tensor正式移除zp和scale的量化参数

* 更新FP32返回值的RKYOLO

* 更新rkyolov5支持fp32格式

* 更新rkyolov5支持fp32格式

* 更新YOLOv5速度文档

Co-authored-by: DefTruth <31974251+DefTruth@users.noreply.github.com>
 2022-12-19 10:03:18 +08:00
DefTruth
6060f4060b [Bug Fix] fix lite int64 datatype convert (#892) 
Co-authored-by: Jason <jiangjiajun@baidu.com>
 2022-12-16 13:29:56 +08:00
Jason
2d998223ac [Backend] Add KunlunXin XPU deploy support (#894) 
Revert "Revert "[Backend] Add KunlunXin XPU deploy support" (#893)"

This reverts commit 0990ab9b50.
 2022-12-16 11:22:30 +08:00
Jason
0990ab9b50 Revert "[Backend] Add KunlunXin XPU deploy support" (#893) 
Revert "[Backend] Add KunlunXin XPU deploy support (#747)"

This reverts commit 5be839b322.
 2022-12-15 21:17:59 +08:00
yeliang2258
5be839b322 [Backend] Add KunlunXin XPU deploy support (#747) 
* add xpu support

* fix docs

* update code

* update doc

* update code

* update yolov5

* update cmake

* add int64_t data support

* fix

* update download links

* add en doc

* update code

* update xpu options

* update doc

* update doc

* update doc

* update lib links

* update doc

* update code

* update lite xpu link

* update xpu lib

* update doc

* update en doc
 2022-12-15 21:17:14 +08:00