Commit Graph

1362 Commits

Author SHA1 Message Date
WJJ1995
4bbfd977c7 [Other] Add onnx_ort_runtime cpp/python demos (#565)
* add onnx_ort_runtime demo

* rm in requirements
2022-11-11 12:47:06 +08:00
Jason
224c2cf1e8 Create devcontainer.json 2022-11-11 11:56:38 +08:00
tripleMu
8ac9354498 [DOCS] Fix url error (#563)
* Fix path error

* Fix typo
2022-11-10 23:04:51 +08:00
Jason
04d364d9d6 [Doc] update version number to 0.6.0 (#552)
update version number
2022-11-10 19:11:24 +08:00
huangjianhui
0d57562c99 [Bug Fix] Fix bugs in release task scripts (#560)
* Fix release_task cpp_run.sh

 Author:    felixhjh <852142024@qq.com>
 Date:      Thu Nov 10 07:26:48 2022 +0000

* Add option for infer_ppyoloe.cc

  author:    felixhjh <852142024@qq.com>

* Fix bug in release task scripts
2022-11-10 18:53:54 +08:00
leiqing
5b338ed898 Update README_CN.md 2022-11-10 18:13:44 +08:00
leiqing
7d7ac80da9 Update README_EN.md 2022-11-10 18:07:55 +08:00
yingshengBD
c7f5d4a168 [ Model ][rk1126] add picodet (#557)
[Example][rk1126] add picodet
2022-11-10 16:21:37 +08:00
heliqi
6bad97351f [Other]Add dlpack (#556)
add dlpack
2022-11-10 16:00:08 +08:00
Jack Zhou
d4995e5468 [Model] Add stable diffusion model based on fastdeploy (#297)
* Add stable diffusion model base on fastdeploy

* Add sd infer

* pipelines->multimodal

* add create_ort_runtime

* use fp16 input

* fix pil

* Add optimize unet model

* add hf license

* Add workspace args

* Add profile func

* Add schedulers

* usrelace torch.Tenosr  byp.ndarray

* Add readme

* Add trt shape setting

* add dynamic shape

* Add dynamic shape for stable diffusion

* fix max shape setting

* rename tensorrt file suffix

* update dynamic shape setting

* Add scheduler output

* Add inference_steps and benchmark steps

* add diffuser benchmark

* Add paddle infer script

* Rename 1

* Rename infer.py to torch_onnx_infer.py

* Add export torch to onnx model

* renmove export model

* Add paddle export model for diffusion

* Fix export model

* mv torch onnx infer to infer

* Fix export model

* Fix infer

* modif create_trt_runtime create_ort_runtime

* update export torch

* update requirements

* add paddle inference backend

* Fix unet pp run

* remove print

* Add paddle model export and infer

* Add device id

* remove profile to utils

* Add -1 device id

* Add safety checker args

* remove safety checker temporarily

* Add export model description

* Add predict description

* Fix readme

* Fix device_id description

* add timestep shape

* add use fp16 precision

* move use gpu

* Add EulerAncestralDiscreteScheduler

* Use EulerAncestralDiscreteScheduler with v1-5 model

* Add export model readme

* Add link of exported model

* Update scheduler on README

* Addd stable-diffusion-v1-5
2022-11-10 14:59:07 +08:00
yeliang2258
fa807340be [Backend] Add Rockchip RV1126 deploy support through PaddleLite TIM-VX (#439)
* add rk1126 support

* update lib

* fix compile bugs

* update doc

* fix complie bug

* update doc

* update doc

* update code

* support model bigger than 2G

* update code

* update code

* update code

* update doc

* update code

* fix bug

* update code

* update code

* update code

* update doc

* update info

* code style check

* update code

* update doc

Co-authored-by: Jason <jiangjiajun@baidu.com>
2022-11-10 10:05:47 +08:00
Zheng_Bicheng
ca0de42d0b [Model] 新增scrfd rknpu2代码 (#504)
* * 新增scrfd rknpu2代码

* * 新增scrfd python代码

* 修正文档

* 修正文档以及部分错误

* 修改文档

* 修复部分错误

* 修复部分错误

* 修复部分错误

* scrfd更新代码

* scrfd更新代码
2022-11-10 10:05:15 +08:00
leiqing
3319a5bdb2 Update README_EN.md 2022-11-09 22:23:01 +08:00
leiqing
eb2cf1afa6 Update README_EN.md 2022-11-09 22:15:46 +08:00
Zheng_Bicheng
795833ad2b [Doc]Fix Doc Error (#547)
* 修正RKPicodet文档

* 修正yolov5文档模型大小的错误

* 修复picodet example代码错误

* 修正文档错误,以及example模型错误
2022-11-09 18:39:58 +08:00
leiqing
52314d6f5f Update README_EN.md 2022-11-09 18:18:37 +08:00
leiqing
9a7a2418a1 Update README_EN.md 2022-11-09 18:15:57 +08:00
leiqing
a72fbc45d6 Update README.md 2022-11-09 17:48:24 +08:00
WJJ1995
2d508a40ec [Doc] Fixed Typo in headpose (#544)
* add paddle_trt in benchmark

* update benchmark in device

* update benchmark

* update result doc

* fixed for CI

* update python api_docs

* update index.rst

* add runtime cpp examples

* deal with comments

* Update infer_paddle_tensorrt.py

* Add runtime quick start

* deal with comments

* fixed reused_input_tensors&&reused_output_tensors

* fixed docs

* fixed headpose typo

* fixed typo

Co-authored-by: Jason <928090362@qq.com>
2022-11-09 17:03:49 +08:00
Jason
30412cb599 Update paddle2onnx.cmake 2022-11-09 15:32:48 +08:00
yunyaoXYY
f1fb9748b3 [Doc] Fix PPOCR readme (#540)
* Add Readme for vision results

* Add Readme for vision results

* Add Readme for vision results

* Add Readme for vision results

* Add Readme for vision results

* Add Readme for vision results

* Add Readme for vision results

* Add Readme for vision results

* Add Readme for vision results

* Add Readme for vision results

* Add comments to create API docs

* Improve OCR comments

* fix conflict

* Fix OCR Readme

* Fix PPOCR readme

* Fix PPOCR readme
2022-11-09 14:39:11 +08:00
WJJ1995
581962bcbb [Doc] Update download_prebuilt_libraries.md (#541)
* add paddle_trt in benchmark

* update benchmark in device

* update benchmark

* update result doc

* fixed for CI

* update python api_docs

* update index.rst

* add runtime cpp examples

* deal with comments

* Update infer_paddle_tensorrt.py

* Add runtime quick start

* deal with comments

* fixed reused_input_tensors&&reused_output_tensors

* fixed docs

Co-authored-by: Jason <928090362@qq.com>
2022-11-09 14:38:50 +08:00
Jason
070458fc72 Update download_prebuilt_libraries.md 2022-11-09 14:12:07 +08:00
Jason
f2fed7959b [Other] Add namespace for functions (#538)
Add namespace for functions
2022-11-09 13:57:53 +08:00
yunyaoXYY
4706a7c32a [Backend] Add SetTrtMaxBatchSize function for TensorRT. (#526)
* Imporve OCR Readme

* Improve OCR Readme

* Improve OCR Readme

* Improve OCR Readme

* Improve OCR Readme

* Add Initialize function to PP-OCR

* Add Initialize function to PP-OCR

* Add Initialize function to PP-OCR

* Make all the model links come from PaddleOCR

* Improve OCR readme

* Improve OCR readme

* Improve OCR readme

* Improve OCR readme

* Add Readme for vision results

* Add Readme for vision results

* Add Readme for vision results

* Add Readme for vision results

* Add Readme for vision results

* Add Readme for vision results

* Add Readme for vision results

* Add Readme for vision results

* Add Readme for vision results

* Add Readme for vision results

* Add check for label file in postprocess of Rec model

* Add check for label file in postprocess of Rec model

* Add check for label file in postprocess of Rec model

* Add check for label file in postprocess of Rec model

* Add check for label file in postprocess of Rec model

* Add check for label file in postprocess of Rec model

* Add comments to create API docs

* Improve OCR comments

* Rename OCR and add comments

* Make sure previous python example works

* Make sure previous python example works

* Fix Rec model bug

* Fix Rec model bug

* Fix rec model bug

* Add SetTrtMaxBatchSize function for TensorRT

* Add SetTrtMaxBatchSize Pybind

* Add set_trt_max_batch_size python function

Co-authored-by: Jason <jiangjiajun@baidu.com>
2022-11-09 13:57:36 +08:00
Zheng_Bicheng
ad04a4377c [Doc]Fix doc error (#539)
* 修正RKPicodet文档

* 修正yolov5文档模型大小的错误
2022-11-09 13:57:02 +08:00
Jason
a37c043979 Update download_prebuilt_libraries.md 2022-11-09 11:37:34 +08:00
Jason
8bf571a127 Update download_prebuilt_libraries.md 2022-11-09 11:37:21 +08:00
Jason
2c9c028dfd Update README.md 2022-11-09 11:31:01 +08:00
Jason
2aa732ed9b Update README.md 2022-11-09 11:30:25 +08:00
yeliang2258
8d31fe59e8 [Backend] Support the deployment of models which is larger than 2G in ORT and TRT backend (#514)
* support model bigger than 2G

* update code

* update code

* fix bug

* update code
2022-11-09 11:14:15 +08:00
WJJ1995
d259952224 [Bug Fix] change reused_input_tensors&&reused_output_tensors name (#534)
* add paddle_trt in benchmark

* update benchmark in device

* update benchmark

* update result doc

* fixed for CI

* update python api_docs

* update index.rst

* add runtime cpp examples

* deal with comments

* Update infer_paddle_tensorrt.py

* Add runtime quick start

* deal with comments

* fixed reused_input_tensors&&reused_output_tensors

Co-authored-by: Jason <928090362@qq.com>
2022-11-09 00:33:33 +08:00
Zeyu Chen
6962921556 Update README_CN.md 2022-11-08 23:06:44 +08:00
GodIsBoom
d02e1cd1d4 [Doc] Add some readme in EN (#529)
* add readme in EN

* code style fix
2022-11-08 21:53:16 +08:00
Jason
e93bf6e35c [Other] Add FDTensor function Pad (#532)
* Add InferShape func for all the vision processors

* fix infer shape of limit short

* Fix infer shape bug of stride_pad

* revert modify of processor

* add function pad
2022-11-08 21:45:31 +08:00
Jason
c7277ef4ac [Test] Fix release task problem (#520)
* Fix release task

* Update compare_with_gt.py

* fix code style
2022-11-08 20:12:22 +08:00
Jason
b0af754cfa [Bug Fix] Remove useless code in tracking (#528) 2022-11-08 19:39:25 +08:00
WJJ1995
4858a3c4b0 [Doc] Add runtime demo in quick_start (#524)
* add paddle_trt in benchmark

* update benchmark in device

* update benchmark

* update result doc

* fixed for CI

* update python api_docs

* update index.rst

* add runtime cpp examples

* deal with comments

* Update infer_paddle_tensorrt.py

* Add runtime quick start

* deal with comments

Co-authored-by: Jason <928090362@qq.com>
2022-11-08 19:37:30 +08:00
DefTruth
7460b2561d [Android] Update fastdeploy Android app ui module (#531)
Revert "[Android] Revert update fastdeploy Android app ui module (#530)"

This reverts commit 628b2d130d.
2022-11-08 19:13:50 +08:00
DefTruth
628b2d130d [Android] Revert update fastdeploy Android app ui module (#530)
Revert "[Android] Update fastdeploy Android app ui module"
2022-11-08 18:59:25 +08:00
DefTruth
8a0b650955 Merge pull request #487 from WinterGeng/gbd_android
[Android] Update fastdeploy Android app ui module
2022-11-08 18:52:13 +08:00
Winter
16dd478409 Merge branch 'PaddlePaddle:develop' into gbd_android 2022-11-08 17:33:31 +08:00
yunyaoXYY
5e75457fd7 [Other] Add reused_input_tensors for PPYOLOE (#523)
* Add PaddleOCR Support

* Add PaddleOCR Support

* Add PaddleOCRv3 Support

* Add PaddleOCRv3 Support

* Update README.md

* Update README.md

* Update README.md

* Update README.md

* Add PaddleOCRv3 Support

* Add PaddleOCRv3 Supports

* Add PaddleOCRv3 Suport

* Fix Rec diff

* Remove useless functions

* Remove useless comments

* Add PaddleOCRv2 Support

* Add PaddleOCRv3 & PaddleOCRv2 Support

* remove useless parameters

* Add utils of sorting det boxes

* Fix code naming convention

* Fix code naming convention

* Fix code naming convention

* Fix bug in the Classify process

* Imporve OCR Readme

* Fix diff in Cls model

* Update Model Download Link in Readme

* Fix diff in PPOCRv2

* Improve OCR readme

* Imporve OCR readme

* Improve OCR readme

* Improve OCR readme

* Imporve OCR readme

* Improve OCR readme

* Fix conflict

* Add readme for OCRResult

* Improve OCR readme

* Add OCRResult readme

* Improve OCR readme

* Improve OCR readme

* Add Model Quantization Demo

* Fix Model Quantization Readme

* Fix Model Quantization Readme

* Add the function to do PTQ quantization

* Improve quant tools readme

* Improve quant tool readme

* Improve quant tool readme

* Add PaddleInference-GPU for OCR Rec model

* Add QAT method to fastdeploy-quantization tool

* Remove examples/slim for now

* Move configs folder

* Add Quantization Support for Classification Model

* Imporve ways of importing preprocess

* Upload YOLO Benchmark on readme

* Upload YOLO Benchmark on readme

* Upload YOLO Benchmark on readme

* Improve Quantization configs and readme

* Add support for multi-inputs model

* Add backends and params file for YOLOv7

* Add quantized model deployment support for YOLO series

* Fix YOLOv5 quantize readme

* Fix YOLO quantize readme

* Fix YOLO quantize readme

* Improve quantize YOLO readme

* Improve quantize YOLO readme

* Improve quantize YOLO readme

* Improve quantize YOLO readme

* Improve quantize YOLO readme

* Fix bug, change Fronted to ModelFormat

* Change Fronted to ModelFormat

* Add examples to deploy quantized paddleclas models

* Fix readme

* Add quantize Readme

* Add quantize Readme

* Add quantize Readme

* Modify readme of quantization tools

* Modify readme of quantization tools

* Improve quantization tools readme

* Improve quantization readme

* Improve PaddleClas quantized model deployment  readme

* Add PPYOLOE-l quantized deployment examples

* Improve quantization tools readme

* Improve Quantize Readme

* Fix conflicts

* Fix conflicts

* improve readme

* Improve quantization tools and readme

* Improve quantization tools and readme

* Add quantized deployment examples for PaddleSeg model

* Fix cpp readme

* Fix memory leak of reader_wrapper function

* Fix model file name in PaddleClas quantization examples

* Update Runtime and E2E benchmark

* Update Runtime and E2E benchmark

* Rename quantization tools to auto compression tools

* Remove PPYOLOE data when deployed on MKLDNN

* Fix readme

* Support PPYOLOE with OR without NMS and update readme

* Update Readme

* Update configs and readme

* Update configs and readme

* Add Paddle-TensorRT backend in quantized model deploy examples

* Support PPYOLOE+ series

* Add reused_input_tensors for PPYOLOE
2022-11-08 17:13:49 +08:00
Winter
0df5e89f4e Merge branch 'PaddlePaddle:develop' into gbd_android 2022-11-08 15:41:27 +08:00
Winter
277c86e612 modify2 2022-11-08 15:36:55 +08:00
Jason
84b5dc5993 [Doc] Add doc shows how to build with third libraries 2022-11-08 15:03:47 +08:00
czr-gc
762f6d9e48 [Bug Fix]: fix paddle2onnx dependency issue. (#522)
fix(paddle_backend): fix paddle2onnx dependency issue.
2022-11-08 15:02:10 +08:00
leiqing
e8343909ca Update README_CN.md 2022-11-08 11:56:12 +08:00
leiqing
f95654b7ef Update README_EN.md 2022-11-08 11:14:26 +08:00
leiqing
0ec697d2ff Update README_CN.md 2022-11-08 11:13:53 +08:00