apps/FastDeploy
1
0
Fork 0
mirror of https://github.com/PaddlePaddle/FastDeploy.git synced 2025-10-09 18:40:18 +08:00
Code Issues Actions 5 Packages Projects Releases Wiki Activity
1,237 Commits 23 Branches 8 Tags
d0fa2fcf5a94e530453d16f46fd8dbbdecb1bfbc
Commit Graph

1237 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Zheng_Bicheng
ad04a4377c [Doc]Fix doc error (#539) 
* 修正RKPicodet文档

* 修正yolov5文档模型大小的错误
 2022-11-09 13:57:02 +08:00
Jason
a37c043979 Update download_prebuilt_libraries.md 2022-11-09 11:37:34 +08:00
Jason
8bf571a127 Update download_prebuilt_libraries.md 2022-11-09 11:37:21 +08:00
Jason
2c9c028dfd Update README.md 2022-11-09 11:31:01 +08:00
Jason
2aa732ed9b Update README.md 2022-11-09 11:30:25 +08:00
yeliang2258
8d31fe59e8 [Backend] Support the deployment of models which is larger than 2G in ORT and TRT backend (#514) 
* support model bigger than 2G

* update code

* update code

* fix bug

* update code
 2022-11-09 11:14:15 +08:00
WJJ1995
d259952224 [Bug Fix] change reused_input_tensors&&reused_output_tensors name (#534) 
* add paddle_trt in benchmark

* update benchmark in device

* update benchmark

* update result doc

* fixed for CI

* update python api_docs

* update index.rst

* add runtime cpp examples

* deal with comments

* Update infer_paddle_tensorrt.py

* Add runtime quick start

* deal with comments

* fixed reused_input_tensors&&reused_output_tensors

Co-authored-by: Jason <928090362@qq.com>
 2022-11-09 00:33:33 +08:00
Zeyu Chen
6962921556 Update README_CN.md 2022-11-08 23:06:44 +08:00
GodIsBoom
d02e1cd1d4 [Doc] Add some readme in EN (#529) 
* add readme in EN

* code style fix
 2022-11-08 21:53:16 +08:00
Jason
e93bf6e35c [Other] Add FDTensor function Pad (#532) 
* Add InferShape func for all the vision processors

* fix infer shape of limit short

* Fix infer shape bug of stride_pad

* revert modify of processor

* add function pad
 2022-11-08 21:45:31 +08:00
Jason
c7277ef4ac [Test] Fix release task problem (#520) 
* Fix release task

* Update compare_with_gt.py

* fix code style
 2022-11-08 20:12:22 +08:00
Jason
b0af754cfa [Bug Fix] Remove useless code in tracking (#528) 2022-11-08 19:39:25 +08:00
WJJ1995
4858a3c4b0 [Doc] Add runtime demo in quick_start (#524) 
* add paddle_trt in benchmark

* update benchmark in device

* update benchmark

* update result doc

* fixed for CI

* update python api_docs

* update index.rst

* add runtime cpp examples

* deal with comments

* Update infer_paddle_tensorrt.py

* Add runtime quick start

* deal with comments

Co-authored-by: Jason <928090362@qq.com>
 2022-11-08 19:37:30 +08:00
DefTruth
7460b2561d [Android] Update fastdeploy Android app ui module (#531) 
Revert "[Android] Revert update fastdeploy Android app ui module (#530)"

This reverts commit 628b2d130d.
 2022-11-08 19:13:50 +08:00
DefTruth
628b2d130d [Android] Revert update fastdeploy Android app ui module (#530) 
Revert "[Android] Update fastdeploy Android app ui module"
 2022-11-08 18:59:25 +08:00
DefTruth
8a0b650955 Merge pull request #487 from WinterGeng/gbd_android 
[Android] Update fastdeploy Android app ui module
 2022-11-08 18:52:13 +08:00
Winter
16dd478409 Merge branch 'PaddlePaddle:develop' into gbd_android 2022-11-08 17:33:31 +08:00
yunyaoXYY
5e75457fd7 [Other] Add reused_input_tensors for PPYOLOE (#523) 
* Add PaddleOCR Support

* Add PaddleOCR Support

* Add PaddleOCRv3 Support

* Add PaddleOCRv3 Support

* Update README.md

* Update README.md

* Update README.md

* Update README.md

* Add PaddleOCRv3 Support

* Add PaddleOCRv3 Supports

* Add PaddleOCRv3 Suport

* Fix Rec diff

* Remove useless functions

* Remove useless comments

* Add PaddleOCRv2 Support

* Add PaddleOCRv3 & PaddleOCRv2 Support

* remove useless parameters

* Add utils of sorting det boxes

* Fix code naming convention

* Fix code naming convention

* Fix code naming convention

* Fix bug in the Classify process

* Imporve OCR Readme

* Fix diff in Cls model

* Update Model Download Link in Readme

* Fix diff in PPOCRv2

* Improve OCR readme

* Imporve OCR readme

* Improve OCR readme

* Improve OCR readme

* Imporve OCR readme

* Improve OCR readme

* Fix conflict

* Add readme for OCRResult

* Improve OCR readme

* Add OCRResult readme

* Improve OCR readme

* Improve OCR readme

* Add Model Quantization Demo

* Fix Model Quantization Readme

* Fix Model Quantization Readme

* Add the function to do PTQ quantization

* Improve quant tools readme

* Improve quant tool readme

* Improve quant tool readme

* Add PaddleInference-GPU for OCR Rec model

* Add QAT method to fastdeploy-quantization tool

* Remove examples/slim for now

* Move configs folder

* Add Quantization Support for Classification Model

* Imporve ways of importing preprocess

* Upload YOLO Benchmark on readme

* Upload YOLO Benchmark on readme

* Upload YOLO Benchmark on readme

* Improve Quantization configs and readme

* Add support for multi-inputs model

* Add backends and params file for YOLOv7

* Add quantized model deployment support for YOLO series

* Fix YOLOv5 quantize readme

* Fix YOLO quantize readme

* Fix YOLO quantize readme

* Improve quantize YOLO readme

* Improve quantize YOLO readme

* Improve quantize YOLO readme

* Improve quantize YOLO readme

* Improve quantize YOLO readme

* Fix bug, change Fronted to ModelFormat

* Change Fronted to ModelFormat

* Add examples to deploy quantized paddleclas models

* Fix readme

* Add quantize Readme

* Add quantize Readme

* Add quantize Readme

* Modify readme of quantization tools

* Modify readme of quantization tools

* Improve quantization tools readme

* Improve quantization readme

* Improve PaddleClas quantized model deployment  readme

* Add PPYOLOE-l quantized deployment examples

* Improve quantization tools readme

* Improve Quantize Readme

* Fix conflicts

* Fix conflicts

* improve readme

* Improve quantization tools and readme

* Improve quantization tools and readme

* Add quantized deployment examples for PaddleSeg model

* Fix cpp readme

* Fix memory leak of reader_wrapper function

* Fix model file name in PaddleClas quantization examples

* Update Runtime and E2E benchmark

* Update Runtime and E2E benchmark

* Rename quantization tools to auto compression tools

* Remove PPYOLOE data when deployed on MKLDNN

* Fix readme

* Support PPYOLOE with OR without NMS and update readme

* Update Readme

* Update configs and readme

* Update configs and readme

* Add Paddle-TensorRT backend in quantized model deploy examples

* Support PPYOLOE+ series

* Add reused_input_tensors for PPYOLOE
 2022-11-08 17:13:49 +08:00
Winter
0df5e89f4e Merge branch 'PaddlePaddle:develop' into gbd_android 2022-11-08 15:41:27 +08:00
Winter
277c86e612 modify2 2022-11-08 15:36:55 +08:00
Jason
84b5dc5993 [Doc] Add doc shows how to build with third libraries 2022-11-08 15:03:47 +08:00
czr-gc
762f6d9e48 [Bug Fix]: fix paddle2onnx dependency issue. (#522) 
fix(paddle_backend): fix paddle2onnx dependency issue.
 2022-11-08 15:02:10 +08:00
leiqing
e8343909ca Update README_CN.md 2022-11-08 11:56:12 +08:00
leiqing
f95654b7ef Update README_EN.md 2022-11-08 11:14:26 +08:00
leiqing
0ec697d2ff Update README_CN.md 2022-11-08 11:13:53 +08:00
Jack Zhou
8fd61e3634 [Model] Add text classification task for ernie-3.0 (#430) 
* move text_cls to ernie-3.0

* Add main page of ernie-3.0

* rename infer -> seq_cls_infer

* Fix the links

* Add ernie-3.0 python, cpp readme

* Fix some cpp readme

* Add fastdeploy::FDERROR

* Add python readme for ernie-3.0

* update README.md

* Add empty line

* update readme

* Fix readme

* remove the - from ernie 3.0

* ernie-3.0 -> ernie 3.0

* Use AutoTokenizer to tokenize

* Ernie -> ERNIE
 2022-11-08 10:54:59 +08:00
DefTruth
09227b2ffc append Merge branch 'develop' into gbd_android 2022-11-08 10:50:01 +08:00
leiqing
bdf40e9da5 Update README_EN.md 2022-11-08 10:39:53 +08:00
leiqing
f302c44829 Update README_CN.md 2022-11-08 10:39:13 +08:00
leiqing
418f30f322 Update README_CN.md 2022-11-08 10:01:52 +08:00
leiqing
55aba486e9 Update README_CN.md 2022-11-08 09:44:25 +08:00
leiqing
97af5493c0 Update README.md 2022-11-08 00:08:14 +08:00
jiangjiajun
21836f8af5 Merge branch 'develop' of https://github.com/PaddlePaddle/FastDeploy into develop 2022-11-07 14:11:02 +00:00
jiangjiajun
b314d66bb7 Fix mobilenetv2 unittest 2022-11-07 14:10:43 +00:00
Wang Xinyu
16266969a1 [backend][model] Fuse bgr2rgb+normalize+hwc2chw, PPClas preprocess optimization (#509) 
* fuse bgr2rgb+normalize+hwc2chw

* add more middle processors in fuse bgr2rgb with normalize

* remove limit long
 2022-11-07 21:40:33 +08:00
Jason
1cae5f888f Update README.md 2022-11-07 21:35:56 +08:00
ziqi-jin
3c0f4c19f9 [Doc] Fix dead links (#517) 
* first commit for yolov7

* pybind for yolov7

* CPP README.md

* CPP README.md

* modified yolov7.cc

* README.md

* python file modify

* delete license in fastdeploy/

* repush the conflict part

* README.md modified

* README.md modified

* file path modified

* file path modified

* file path modified

* file path modified

* file path modified

* README modified

* README modified

* move some helpers to private

* add examples for yolov7

* api.md modified

* api.md modified

* api.md modified

* YOLOv7

* yolov7 release link

* yolov7 release link

* yolov7 release link

* copyright

* change some helpers to private

* change variables to const and fix documents.

* gitignore

* Transfer some funtions to private member of class

* Transfer some funtions to private member of class

* Merge from develop (#9)

* Fix compile problem in different python version (#26)

* fix some usage problem in linux

* Fix compile problem

Co-authored-by: root <root@bjyz-sys-gpu-kongming3.bjyz.baidu.com>

* Add PaddleDetetion/PPYOLOE model support (#22)

* add ppdet/ppyoloe

* Add demo code and documents

* add convert processor to vision (#27)

* update .gitignore

* Added checking for cmake include dir

* fixed missing trt_backend option bug when init from trt

* remove un-need data layout and add pre-check for dtype

* changed RGB2BRG to BGR2RGB in ppcls model

* add model_zoo yolov6 c++/python demo

* fixed CMakeLists.txt typos

* update yolov6 cpp/README.md

* add yolox c++/pybind and model_zoo demo

* move some helpers to private

* fixed CMakeLists.txt typos

* add normalize with alpha and beta

* add version notes for yolov5/yolov6/yolox

* add copyright to yolov5.cc

* revert normalize

* fixed some bugs in yolox

* fixed examples/CMakeLists.txt to avoid conflicts

* add convert processor to vision

* format examples/CMakeLists summary

* Fix bug while the inference result is empty with YOLOv5 (#29)

* Add multi-label function for yolov5

* Update README.md

Update doc

* Update fastdeploy_runtime.cc

fix variable option.trt_max_shape wrong name

* Update runtime_option.md

Update resnet model dynamic shape setting name from images to x

* Fix bug when inference result boxes are empty

* Delete detection.py

Co-authored-by: Jason <jiangjiajun@baidu.com>
Co-authored-by: root <root@bjyz-sys-gpu-kongming3.bjyz.baidu.com>
Co-authored-by: DefTruth <31974251+DefTruth@users.noreply.github.com>
Co-authored-by: huangjianhui <852142024@qq.com>

* first commit for yolor

* for merge

* Develop (#11)

* Fix compile problem in different python version (#26)

* fix some usage problem in linux

* Fix compile problem

Co-authored-by: root <root@bjyz-sys-gpu-kongming3.bjyz.baidu.com>

* Add PaddleDetetion/PPYOLOE model support (#22)

* add ppdet/ppyoloe

* Add demo code and documents

* add convert processor to vision (#27)

* update .gitignore

* Added checking for cmake include dir

* fixed missing trt_backend option bug when init from trt

* remove un-need data layout and add pre-check for dtype

* changed RGB2BRG to BGR2RGB in ppcls model

* add model_zoo yolov6 c++/python demo

* fixed CMakeLists.txt typos

* update yolov6 cpp/README.md

* add yolox c++/pybind and model_zoo demo

* move some helpers to private

* fixed CMakeLists.txt typos

* add normalize with alpha and beta

* add version notes for yolov5/yolov6/yolox

* add copyright to yolov5.cc

* revert normalize

* fixed some bugs in yolox

* fixed examples/CMakeLists.txt to avoid conflicts

* add convert processor to vision

* format examples/CMakeLists summary

* Fix bug while the inference result is empty with YOLOv5 (#29)

* Add multi-label function for yolov5

* Update README.md

Update doc

* Update fastdeploy_runtime.cc

fix variable option.trt_max_shape wrong name

* Update runtime_option.md

Update resnet model dynamic shape setting name from images to x

* Fix bug when inference result boxes are empty

* Delete detection.py

Co-authored-by: Jason <jiangjiajun@baidu.com>
Co-authored-by: root <root@bjyz-sys-gpu-kongming3.bjyz.baidu.com>
Co-authored-by: DefTruth <31974251+DefTruth@users.noreply.github.com>
Co-authored-by: huangjianhui <852142024@qq.com>

* Yolor (#16)

* Develop (#11) (#12)

* Fix compile problem in different python version (#26)

* fix some usage problem in linux

* Fix compile problem

Co-authored-by: root <root@bjyz-sys-gpu-kongming3.bjyz.baidu.com>

* Add PaddleDetetion/PPYOLOE model support (#22)

* add ppdet/ppyoloe

* Add demo code and documents

* add convert processor to vision (#27)

* update .gitignore

* Added checking for cmake include dir

* fixed missing trt_backend option bug when init from trt

* remove un-need data layout and add pre-check for dtype

* changed RGB2BRG to BGR2RGB in ppcls model

* add model_zoo yolov6 c++/python demo

* fixed CMakeLists.txt typos

* update yolov6 cpp/README.md

* add yolox c++/pybind and model_zoo demo

* move some helpers to private

* fixed CMakeLists.txt typos

* add normalize with alpha and beta

* add version notes for yolov5/yolov6/yolox

* add copyright to yolov5.cc

* revert normalize

* fixed some bugs in yolox

* fixed examples/CMakeLists.txt to avoid conflicts

* add convert processor to vision

* format examples/CMakeLists summary

* Fix bug while the inference result is empty with YOLOv5 (#29)

* Add multi-label function for yolov5

* Update README.md

Update doc

* Update fastdeploy_runtime.cc

fix variable option.trt_max_shape wrong name

* Update runtime_option.md

Update resnet model dynamic shape setting name from images to x

* Fix bug when inference result boxes are empty

* Delete detection.py

Co-authored-by: Jason <jiangjiajun@baidu.com>
Co-authored-by: root <root@bjyz-sys-gpu-kongming3.bjyz.baidu.com>
Co-authored-by: DefTruth <31974251+DefTruth@users.noreply.github.com>
Co-authored-by: huangjianhui <852142024@qq.com>

Co-authored-by: Jason <jiangjiajun@baidu.com>
Co-authored-by: root <root@bjyz-sys-gpu-kongming3.bjyz.baidu.com>
Co-authored-by: DefTruth <31974251+DefTruth@users.noreply.github.com>
Co-authored-by: huangjianhui <852142024@qq.com>

* Develop (#13)

* Fix compile problem in different python version (#26)

* fix some usage problem in linux

* Fix compile problem

Co-authored-by: root <root@bjyz-sys-gpu-kongming3.bjyz.baidu.com>

* Add PaddleDetetion/PPYOLOE model support (#22)

* add ppdet/ppyoloe

* Add demo code and documents

* add convert processor to vision (#27)

* update .gitignore

* Added checking for cmake include dir

* fixed missing trt_backend option bug when init from trt

* remove un-need data layout and add pre-check for dtype

* changed RGB2BRG to BGR2RGB in ppcls model

* add model_zoo yolov6 c++/python demo

* fixed CMakeLists.txt typos

* update yolov6 cpp/README.md

* add yolox c++/pybind and model_zoo demo

* move some helpers to private

* fixed CMakeLists.txt typos

* add normalize with alpha and beta

* add version notes for yolov5/yolov6/yolox

* add copyright to yolov5.cc

* revert normalize

* fixed some bugs in yolox

* fixed examples/CMakeLists.txt to avoid conflicts

* add convert processor to vision

* format examples/CMakeLists summary

* Fix bug while the inference result is empty with YOLOv5 (#29)

* Add multi-label function for yolov5

* Update README.md

Update doc

* Update fastdeploy_runtime.cc

fix variable option.trt_max_shape wrong name

* Update runtime_option.md

Update resnet model dynamic shape setting name from images to x

* Fix bug when inference result boxes are empty

* Delete detection.py

Co-authored-by: Jason <jiangjiajun@baidu.com>
Co-authored-by: root <root@bjyz-sys-gpu-kongming3.bjyz.baidu.com>
Co-authored-by: DefTruth <31974251+DefTruth@users.noreply.github.com>
Co-authored-by: huangjianhui <852142024@qq.com>

* documents

* documents

* documents

* documents

* documents

* documents

* documents

* documents

* documents

* documents

* documents

* documents

* Develop (#14)

* Fix compile problem in different python version (#26)

* fix some usage problem in linux

* Fix compile problem

Co-authored-by: root <root@bjyz-sys-gpu-kongming3.bjyz.baidu.com>

* Add PaddleDetetion/PPYOLOE model support (#22)

* add ppdet/ppyoloe

* Add demo code and documents

* add convert processor to vision (#27)

* update .gitignore

* Added checking for cmake include dir

* fixed missing trt_backend option bug when init from trt

* remove un-need data layout and add pre-check for dtype

* changed RGB2BRG to BGR2RGB in ppcls model

* add model_zoo yolov6 c++/python demo

* fixed CMakeLists.txt typos

* update yolov6 cpp/README.md

* add yolox c++/pybind and model_zoo demo

* move some helpers to private

* fixed CMakeLists.txt typos

* add normalize with alpha and beta

* add version notes for yolov5/yolov6/yolox

* add copyright to yolov5.cc

* revert normalize

* fixed some bugs in yolox

* fixed examples/CMakeLists.txt to avoid conflicts

* add convert processor to vision

* format examples/CMakeLists summary

* Fix bug while the inference result is empty with YOLOv5 (#29)

* Add multi-label function for yolov5

* Update README.md

Update doc

* Update fastdeploy_runtime.cc

fix variable option.trt_max_shape wrong name

* Update runtime_option.md

Update resnet model dynamic shape setting name from images to x

* Fix bug when inference result boxes are empty

* Delete detection.py

Co-authored-by: root <root@bjyz-sys-gpu-kongming3.bjyz.baidu.com>
Co-authored-by: DefTruth <31974251+DefTruth@users.noreply.github.com>
Co-authored-by: huangjianhui <852142024@qq.com>

Co-authored-by: Jason <jiangjiajun@baidu.com>
Co-authored-by: root <root@bjyz-sys-gpu-kongming3.bjyz.baidu.com>
Co-authored-by: DefTruth <31974251+DefTruth@users.noreply.github.com>
Co-authored-by: huangjianhui <852142024@qq.com>
Co-authored-by: Jason <928090362@qq.com>

* add is_dynamic for YOLO series (#22)

* modify ppmatting backend and docs

* modify ppmatting docs

* fix the PPMatting size problem

* fix LimitShort's log

* retrigger ci

* modify PPMatting docs

* modify the way  for dealing with  LimitShort

* add python comments for external models

* modify resnet c++ comments

* modify C++ comments for external models

* modify python comments and add result class comments

* fix comments compile error

* modify result.h comments

* first commit for dead links

* first commit for dead links

* fix docs deadlinks

* fix docs deadlinks

* fix examples deadlinks

* fix examples deadlinks

Co-authored-by: Jason <jiangjiajun@baidu.com>
Co-authored-by: root <root@bjyz-sys-gpu-kongming3.bjyz.baidu.com>
Co-authored-by: DefTruth <31974251+DefTruth@users.noreply.github.com>
Co-authored-by: huangjianhui <852142024@qq.com>
Co-authored-by: Jason <928090362@qq.com>
 2022-11-07 20:49:41 +08:00
WJJ1995
0bb40ab100 [Other] Add runtime cpp demos (#515) 
* add paddle_trt in benchmark

* update benchmark in device

* update benchmark

* update result doc

* fixed for CI

* update python api_docs

* update index.rst

* add runtime cpp examples

* deal with comments

* Update infer_paddle_tensorrt.py

Co-authored-by: Jason <928090362@qq.com>
 2022-11-07 19:49:12 +08:00
DefTruth
ff24ed6a54 [Other] Add global SetProcLibCpuNumThreads method (#513) 
[FlyCV] Add global SetProcLibCpuNumThreads method
 2022-11-07 19:45:12 +08:00
Jason
3589c0fa94 [Model] Refactor PaddleClas module (#505) 
* Refactor the PaddleClas module

* fix bug

* remove debug code

* clean unused code

* support pybind

* Update fd_tensor.h

* Update fd_tensor.cc

* temporary revert python api

* fix ci error

* fix code style problem
 2022-11-07 19:33:47 +08:00
WinterGeng
87823173bb specification has submitted code. 2022-11-07 18:50:53 +08:00
DefTruth
856b623cad Merge branch 'develop' into gbd_android 2022-11-07 15:35:04 +08:00
Jason
a0a8ace174 Update limit_short.cc 2022-11-07 15:13:53 +08:00
Winter
357135ef62 Merge branch 'PaddlePaddle:develop' into gbd_android 2022-11-07 15:12:47 +08:00
Jason
6633fa3db9 [Model] [Part 1] Refactor PaddleClas module (#508) 
* Split PaddleClas Module refactor

* Split PaddleClas Module refactor

* fix bug
 2022-11-07 15:09:00 +08:00
WJJ1995
40b099ac99 [Doc] Update api_docs in python (#511) 
* add paddle_trt in benchmark

* update benchmark in device

* update benchmark

* update result doc

* fixed for CI

* update python api_docs
 2022-11-07 14:25:46 +08:00
leiqing
bf5c1aec65 Update README_EN.md 2022-11-07 10:09:05 +08:00
leiqing
152b2770c8 Update README_EN.md 2022-11-07 10:07:31 +08:00
Jack Zhou
70f664161f [Functions] Add fd tensor concat (#507) 
* Add fd tensor concat

* fix comment
 2022-11-07 10:02:42 +08:00
leiqing
5caded06a3 Update README_EN.md 2022-11-07 00:34:43 +08:00