Commit Graph

3104 Commits

Author SHA1 Message Date
Zheng-Bicheng
b30f62af36 [Backend] Refactoring RKNPU2 Backend code (#1772)
* update rknpu2 runtime

* update rknpu2 runtime

* update rknpu2 runtime

* update for rknpu2 backend

* update for rknpu2 backend

---------

Co-authored-by: DefTruth <31974251+DefTruth@users.noreply.github.com>
2023-04-13 16:37:36 +08:00
linyangshi
60a44f5af1 [Benchmark] add PaddleDetection to benchmark (#1675)
* 添加paddleclas模型

* 更新README_CN

* 更新README_CN

* 更新README

* update get_model.sh

* update get_models.sh

* update paddleseg models

* update paddle_seg models

* update paddle_seg models

* modified test resources

* update benchmark_gpu_trt.sh

* add paddle detection

* add paddledetection to benchmark

* modified benchmark cmakelists

* update benchmark scripts

* modified benchmark function calling

---------

Co-authored-by: DefTruth <31974251+DefTruth@users.noreply.github.com>
2023-04-13 10:29:49 +08:00
DefTruth
d1da460230 [Bug Fix] fix fastdeploy & paddle import conflict on windows (#1796)
Update paddle_inference.cmake
2023-04-12 09:32:08 +08:00
DefTruth
9ec419129f [XPU] Update Lite XPU lib to fix l3 cache crash for seg models (#1786)
* Update kunlunxin.cmake

* [XPU] Update Lite XPU lib to fix l3 cache crash
2023-04-11 18:01:52 +08:00
yeliang2258
e2f5a9ce66 [Model] Add picodet for RV1126 and A311D (#1549)
* add infer for picodet

* update code

* update lite lib

---------

Co-authored-by: DefTruth <31974251+DefTruth@users.noreply.github.com>
2023-04-10 22:04:45 +08:00
hjyp
cc4bbf2163 [PaddlePaddle Hackathon4 No.185] Add PaddleDetection Models Deployment Java Examples (#1782)
* add java examples

* fix detail

* fix pre-config

---------

Co-authored-by: DefTruth <31974251+DefTruth@users.noreply.github.com>
2023-04-10 21:23:44 +08:00
chenjian
fc15124800 [Doc] add doxygen docs for c sharp api (#1495)
add doxygen docs for c sharp api

Co-authored-by: DefTruth <31974251+DefTruth@users.noreply.github.com>
2023-04-09 12:32:22 +08:00
guxukai
ed19c759df [CVCUDA] Add CV-CUDA support in PaddleSeg (#1761)
* add cvcuda support in ppseg

* python and pybind

* add resize op, remove concat,std::move

* define resize op
2023-04-09 10:38:18 +08:00
DefTruth
c90aa7bd6f [Bug Fix] fixed fastdeploy & paddle_inference import conflict (#1780)
* [cmake] Update paddle_inference.cmake

* Update paddle_inference.cmake

* Update paddle_inference.cmake
2023-04-08 19:25:44 +08:00
yeliang2258
7b0c55d0c5 [Backend] Add KunlunXin on aarch64 platform (#1701)
* add xpu in aarch64

* reverse

* fix lib url

---------

Co-authored-by: DefTruth <31974251+DefTruth@users.noreply.github.com>
2023-04-08 14:28:33 +08:00
DefTruth
a40d6ee093 [benchmark] Update config.xpu.lite.fp32.l3.e2e.mem.txt 2023-04-07 10:41:36 +08:00
DefTruth
df11896820 [cmake] Update paddle inference linux -> 2.4 dev8 (#1767) 2023-04-04 22:07:56 +08:00
Zheng-Bicheng
109d1046ae [Model] add function for setting anchor rknpu2 (#1728)
* add function for setting anchor rknpu2
add more demo for rknpu2
fixed md error

* Update config.h

---------

Co-authored-by: DefTruth <31974251+DefTruth@users.noreply.github.com>
2023-04-04 20:33:06 +08:00
ChaoII
a2141d0d2c [Doc] fix dead links (#1732)
* [Bug Fix]fix tracking 'LetterBoxResize'

* [Docs]Fix dead links

---------

Co-authored-by: DefTruth <31974251+DefTruth@users.noreply.github.com>
2023-04-03 13:09:57 +08:00
wanziyu
95c977c638 [PaddlePaddle Hackathon4 No.184] Add PaddleDetection Models Deployment Rust Examples (#1717)
* [PaddlePaddle Hackathon4 No.186] Add PaddleDetection Models Deployment Go Examples

Signed-off-by: wanziyu <ziyuwan@zju.edu.cn>

* Fix YOLOv8 Deployment Go Example

Signed-off-by: wanziyu <ziyuwan@zju.edu.cn>

* [Hackathon4 No.184] Add PaddleDetection Models Deployment Rust Examples

Signed-off-by: wanziyu <ziyuwan@zju.edu.cn>

* Add main and cargo files in examples

Signed-off-by: wanziyu <ziyuwan@zju.edu.cn>

---------

Signed-off-by: wanziyu <ziyuwan@zju.edu.cn>
Co-authored-by: DefTruth <31974251+DefTruth@users.noreply.github.com>
2023-04-03 11:19:28 +08:00
DefTruth
8772e3d86b [Docs] Update rknpu2.md cross compile toolchain 2023-03-31 16:41:06 +08:00
Yi-sir
9e20dab0d6 [Example] Merge Download Paddle Model, Paddle->ONNX->MLIR->BModel (#1643)
* fix infer.py and README

* [Example] Merge Download Paddle Model, Paddle->Onnx->Mlir->Bmodel and
inference into infer.py. Modify README.md

* modify pp_liteseg sophgo infer.py and README.md

* fix PPOCR,PPYOLOE,PICODET,LITESEG sophgo infer.py and README.md

* fix memory overflow problem while inferring with sophgo backend

* fix memory overflow problem while inferring with sophgo backend

---------

Co-authored-by: DefTruth <31974251+DefTruth@users.noreply.github.com>
Co-authored-by: xuyizhou <yizhou.xu@sophgo.com>
2023-03-31 15:08:01 +08:00
Zheng-Bicheng
8deb2ed179 [Docs] fixed rknn building docs (#1754)
* fixed rknn building docs

* fixed rknn building docs

* fixed rknn building docs

* fixed rknn building docs

* fixed rknn building docs

* fixed rknn building docs

* fixed rknn building docs
2023-03-31 10:43:45 +08:00
WJJ1995
82ce988573 [Benchmark]Fixed benchmark config default device id (#1749)
* add GPL lisence

* add GPL-3.0 lisence

* add GPL-3.0 lisence

* add GPL-3.0 lisence

* support yolov8

* add pybind for yolov8

* add yolov8 readme

* add cpp benchmark

* add cpu and gpu mem

* public part split

* add runtime mode

* fixed bugs

* add cpu_thread_nums

* deal with comments

* deal with comments

* deal with comments

* rm useless code

* add FASTDEPLOY_DECL

* add FASTDEPLOY_DECL

* fixed for windows

* mv rss to pss

* mv rss to pss

* Update utils.cc

* use thread to collect mem

* Add ResourceUsageMonitor

* rm useless code

* fixed bug

* fixed typo

* update ResourceUsageMonitor

* fixed bug

* fixed bug

* add note for ResourceUsageMonitor

* deal with comments

* add macros

* deal with comments

* deal with comments

* deal with comments

* re-lint

* rm pmap and use mem api

* rm pmap and use mem api

* add mem api

* Add PrintBenchmarkInfo func

* Add PrintBenchmarkInfo func

* Add PrintBenchmarkInfo func

* deal with comments

* fixed enable_paddle_to_trt

* add log for paddle_trt

* support ppcls benchmark

* use new trt option api

* update benchmark info

* simplify benchmark.cc

* simplify benchmark.cc

* deal with comments

* Add ppseg && ppocr benchmark

* add OCR rec img

* add ocr benchmark

* fixed trt shape

* add trt shape

* resolve conflict

* add ENABLE_BENCHMARK define

* Add ClassifyDiff

* Add Resize for ClassifyResult

* deal with comments

* add convert info script

* resolve conflict

* Add SaveBenchmarkResult func

* fixed bug

* fixed bug

* fixed bug

* add config.txt for option

* fixed bug

* fixed bug

* fixed bug

* add benchmark.sh

* mv thread_nums from 8 to 1

* deal with comments

* deal with comments

* fixed readme

* deal with comments

* add all platform shell

* Update config.arm.txt

* Update config.gpu.txt

* Update config.x86.txt

* fixed printinfo bug

* rm proxy

* add more model support

* all backend config.txt

* deal with comments

* Add MattingDiff compare

* fixed predict bug

* adjust warmup/repeat times

* add e2e/mem configs

* fixed typo

* open collect_mem

* fixed typo

* add trt cache option

* fixed bug

* fixed repeat times

* test for benchmark

* test for det benchmark

* for benchmark

* fixed for x86

* add h2d and d2h config

* renmae txt file

* add dynamic shape for pp_trt

* fixed typo

* Update option.h

* add collect shape

* add default value for SetShape()

* add test

* test

* fixed benchmark config

---------

Co-authored-by: DefTruth <31974251+DefTruth@users.noreply.github.com>
2023-03-30 21:20:56 +08:00
DefTruth
452885b089 [benchmark] fixed runtime benchmark bin macros bug (#1748)
* [Benchmark] Add pure runtime benchmark bin

* [Benchmark] add cpu/gpu memory collect -> benchmark bin

* [Backend] update trt max_batch_size policy

* [backend] Update trt backend max_batch_size policy

* [Benchmark] Add more model format support -> benchmark bin

* [benchmark] fixed runtime benchmark bin marcos bug
2023-03-30 21:08:38 +08:00
DefTruth
7d1b706caf [Benchmark] Add pure runtime benchmark bin (#1731)
* [Benchmark] Add pure runtime benchmark bin

* [Benchmark] add cpu/gpu memory collect -> benchmark bin

* [Backend] update trt max_batch_size policy

* [backend] Update trt backend max_batch_size policy

* [Benchmark] Add more model format support -> benchmark bin
2023-03-30 19:03:30 +08:00
CoolCola
f4a7008732 [Streamer] Build python wheel and python API (#1702)
* add setup.py

* fix setup.py

* fix setup.py

* fix setup.py

* fix setup.py

* fix setup.py

* fix setup.py

* fix setup.py

* fix setup.py

* fix setup.py

* add scripts

* fix setup.py

* fix setup.py

* fix setup.py

* fix setup.py

* add pybind interface

* update CMakeLists

* fix CMakeLists

* fix setup.py

* fix setup.py

* fix setup

* fix CMakeLists

* fix CMakeLists

* fix CMakeLists

* fix pybind

* fix pybind

* fix pybind

* fix pybind

* fix CMakeLists

* fix CMakeLists

* fix CMakeLists

* fix CMakeLists

* fix CMakeLists

* fix CMakeLists

* fix CMakeLists

* fix CMakeLists.txt

* fix CMakeLists.txt

* fix CMakeLists

* fix CMakeLists

* fix CMakeLists

* fix process_libraries

* test setup

* fix setup

* fix py wheel build

* add ppyoloe py streamer

* delete annotation, fix form

---------

Co-authored-by: Wang Xinyu <shaywxy@gmail.com>
2023-03-30 14:22:46 +08:00
Zeref996
c04a3a4e35 [Dev] fix dev version number (#1742) 2023-03-30 10:33:39 +08:00
Zheng-Bicheng
644a085ca2 [Bug Fix] fix yolox's bug (#1736)
fix yolox's bug

Co-authored-by: DefTruth <31974251+DefTruth@users.noreply.github.com>
2023-03-29 21:03:37 +08:00
guxukai
38f056d1c1 [CVCUDA] PP-OCR and PPDet preprocessor support use_cuda python API(#1734)
add cvcuda support in ppocr and ppdet
2023-03-29 20:57:36 +08:00
Zeref996
3ef48f7746 add fdbenchmark run_gpu.sh and run_x86.sh (#1741) 2023-03-29 19:36:58 +08:00
Zeref996
edbe71f68d Merge pull request #1733 from Zeref996/refresh-doc-1.0.5
Refresh doc version 1.0.5
2023-03-29 16:12:56 +08:00
CoolCola
18a39ce59d [Streamer] Add fdtracker plugin (#1668)
* add fdtracker plugin

* upload fdtracker

* delete test modle

* fix review problem

* fix code style

* fix code style

* fix copy right, delete travial annotation

* fix copy right

* fix compile error

---------

Co-authored-by: jiangjiajun <jiangjiajun@baidu.com>
2023-03-29 13:56:10 +08:00
Jason
7507003113 Update __init__.py 2023-03-29 12:57:40 +08:00
Zeref996
b00cb4223d refresh doc version 1.0.5 2023-03-29 11:05:10 +08:00
Zeref996
ea52ec9065 Merge branch 'develop' of https://github.com/PaddlePaddle/FastDeploy into release/1.0.5 2023-03-29 10:52:49 +08:00
wanziyu
b1d2903b93 [PaddlePaddle Hackathon4 No.186] Add PaddleDetection Models Deployment Go Examples (#1648)
* [PaddlePaddle Hackathon4 No.186] Add PaddleDetection Models Deployment Go Examples

Signed-off-by: wanziyu <ziyuwan@zju.edu.cn>

* Fix YOLOv8 Deployment Go Example

Signed-off-by: wanziyu <ziyuwan@zju.edu.cn>

---------

Signed-off-by: wanziyu <ziyuwan@zju.edu.cn>
Co-authored-by: DefTruth <31974251+DefTruth@users.noreply.github.com>
2023-03-28 20:30:03 +08:00
DefTruth
b15df7a8ee Update benchmark_gpu_trt.sh 2023-03-28 13:29:30 +08:00
DefTruth
3ed3e303aa Update config.gpu.trt.fp32.txt 2023-03-28 11:55:51 +08:00
DefTruth
dda23bce95 Update config.gpu.trt.fp32.h2d.txt 2023-03-28 11:55:34 +08:00
DefTruth
fe7c40f1ff Update config.gpu.trt.fp32.e2e.txt 2023-03-28 11:55:11 +08:00
DefTruth
7be66c811e Update config.gpu.trt.fp32.e2e.mem.txt 2023-03-28 11:54:47 +08:00
DefTruth
57b5c598a7 Update config.gpu.trt.fp16.txt 2023-03-28 11:54:22 +08:00
DefTruth
7936833451 Update config.gpu.trt.fp16.h2d.txt 2023-03-28 11:54:00 +08:00
DefTruth
76936391e3 Update config.gpu.trt.fp16.e2e.txt 2023-03-28 11:53:29 +08:00
DefTruth
5f273b2541 Update config.gpu.trt.fp16.e2e.mem.txt 2023-03-28 11:53:08 +08:00
Wang Xinyu
d19b85b0e1 [Streamer] add fdinfer plugin (#1716)
fdinfer plugin
2023-03-27 19:43:09 +08:00
Jack Zhou
a3f9c1f8e3 Merge pull request #1667 from Zeref996/fix-dockerf-00
fix dockerfile paddle install url
2023-03-27 16:32:29 +08:00
wangguoya
c61a07712e fix bug for kunlunxin run sd demo for uing fp16 (#1680)
* modify sd infer.py for using paddle_kunlunxin_fp16

* Update infer.py

* [fix bug] fix bug sd in demo infer.py for kunlunxin using fp16
2023-03-27 14:04:21 +08:00
WJJ1995
409c5dc056 [Backend]Add default value for TRT SetShape() (#1712)
* add GPL lisence

* add GPL-3.0 lisence

* add GPL-3.0 lisence

* add GPL-3.0 lisence

* support yolov8

* add pybind for yolov8

* add yolov8 readme

* add cpp benchmark

* add cpu and gpu mem

* public part split

* add runtime mode

* fixed bugs

* add cpu_thread_nums

* deal with comments

* deal with comments

* deal with comments

* rm useless code

* add FASTDEPLOY_DECL

* add FASTDEPLOY_DECL

* fixed for windows

* mv rss to pss

* mv rss to pss

* Update utils.cc

* use thread to collect mem

* Add ResourceUsageMonitor

* rm useless code

* fixed bug

* fixed typo

* update ResourceUsageMonitor

* fixed bug

* fixed bug

* add note for ResourceUsageMonitor

* deal with comments

* add macros

* deal with comments

* deal with comments

* deal with comments

* re-lint

* rm pmap and use mem api

* rm pmap and use mem api

* add mem api

* Add PrintBenchmarkInfo func

* Add PrintBenchmarkInfo func

* Add PrintBenchmarkInfo func

* deal with comments

* fixed enable_paddle_to_trt

* add log for paddle_trt

* support ppcls benchmark

* use new trt option api

* update benchmark info

* simplify benchmark.cc

* simplify benchmark.cc

* deal with comments

* Add ppseg && ppocr benchmark

* add OCR rec img

* add ocr benchmark

* fixed trt shape

* add trt shape

* resolve conflict

* add ENABLE_BENCHMARK define

* Add ClassifyDiff

* Add Resize for ClassifyResult

* deal with comments

* add convert info script

* resolve conflict

* Add SaveBenchmarkResult func

* fixed bug

* fixed bug

* fixed bug

* add config.txt for option

* fixed bug

* fixed bug

* fixed bug

* add benchmark.sh

* mv thread_nums from 8 to 1

* deal with comments

* deal with comments

* fixed readme

* deal with comments

* add all platform shell

* Update config.arm.txt

* Update config.gpu.txt

* Update config.x86.txt

* fixed printinfo bug

* rm proxy

* add more model support

* all backend config.txt

* deal with comments

* Add MattingDiff compare

* fixed predict bug

* adjust warmup/repeat times

* add e2e/mem configs

* fixed typo

* open collect_mem

* fixed typo

* add trt cache option

* fixed bug

* fixed repeat times

* test for benchmark

* test for det benchmark

* for benchmark

* fixed for x86

* add h2d and d2h config

* renmae txt file

* add dynamic shape for pp_trt

* fixed typo

* Update option.h

* add collect shape

* add default value for SetShape()

---------

Co-authored-by: DefTruth <31974251+DefTruth@users.noreply.github.com>
2023-03-27 14:03:47 +08:00
ChaoII
d43e9011eb [Bug Fix]fix tracking 'LetterBoxResize' (#1711) 2023-03-27 14:03:09 +08:00
WJJ1995
0c543c010e [Benchmark] Add dynamic shape for pp_trt (#1703)
* add GPL lisence

* add GPL-3.0 lisence

* add GPL-3.0 lisence

* add GPL-3.0 lisence

* support yolov8

* add pybind for yolov8

* add yolov8 readme

* add cpp benchmark

* add cpu and gpu mem

* public part split

* add runtime mode

* fixed bugs

* add cpu_thread_nums

* deal with comments

* deal with comments

* deal with comments

* rm useless code

* add FASTDEPLOY_DECL

* add FASTDEPLOY_DECL

* fixed for windows

* mv rss to pss

* mv rss to pss

* Update utils.cc

* use thread to collect mem

* Add ResourceUsageMonitor

* rm useless code

* fixed bug

* fixed typo

* update ResourceUsageMonitor

* fixed bug

* fixed bug

* add note for ResourceUsageMonitor

* deal with comments

* add macros

* deal with comments

* deal with comments

* deal with comments

* re-lint

* rm pmap and use mem api

* rm pmap and use mem api

* add mem api

* Add PrintBenchmarkInfo func

* Add PrintBenchmarkInfo func

* Add PrintBenchmarkInfo func

* deal with comments

* fixed enable_paddle_to_trt

* add log for paddle_trt

* support ppcls benchmark

* use new trt option api

* update benchmark info

* simplify benchmark.cc

* simplify benchmark.cc

* deal with comments

* Add ppseg && ppocr benchmark

* add OCR rec img

* add ocr benchmark

* fixed trt shape

* add trt shape

* resolve conflict

* add ENABLE_BENCHMARK define

* Add ClassifyDiff

* Add Resize for ClassifyResult

* deal with comments

* add convert info script

* resolve conflict

* Add SaveBenchmarkResult func

* fixed bug

* fixed bug

* fixed bug

* add config.txt for option

* fixed bug

* fixed bug

* fixed bug

* add benchmark.sh

* mv thread_nums from 8 to 1

* deal with comments

* deal with comments

* fixed readme

* deal with comments

* add all platform shell

* Update config.arm.txt

* Update config.gpu.txt

* Update config.x86.txt

* fixed printinfo bug

* rm proxy

* add more model support

* all backend config.txt

* deal with comments

* Add MattingDiff compare

* fixed predict bug

* adjust warmup/repeat times

* add e2e/mem configs

* fixed typo

* open collect_mem

* fixed typo

* add trt cache option

* fixed bug

* fixed repeat times

* test for benchmark

* test for det benchmark

* for benchmark

* fixed for x86

* add h2d and d2h config

* renmae txt file

* add dynamic shape for pp_trt

* fixed typo

* Update option.h

* add collect shape

---------

Co-authored-by: DefTruth <31974251+DefTruth@users.noreply.github.com>
2023-03-24 23:07:10 +08:00
WJJ1995
5c70db176f [Backend]Add switch_ir_debug for Paddle Backend (#1700)
* avoid mem copy for cpp benchmark

* set CMAKE_BUILD_TYPE to Release

* Add SegmentationDiff

* change pointer to reference

* fixed bug

* cast uint8 to int32

* Add diff compare for OCR

* Add diff compare for OCR

* rm ppocr pipeline

* Add yolov5 diff compare

* Add yolov5 diff compare

* deal with comments

* deal with comments

* fixed bug

* fixed bug

* fixed thread nums

* Add Failed log

* optimizer x86 pipeline

* Add switch_ir_debug for paddle backend

* fixed for ci
2023-03-24 17:29:31 +08:00
guxukai
631f94d276 [CVCUDA] Update CV-CUDA to v0.2.1, add vision processor C++ tutorial (#1678)
* update cvcuda 0.2.0 -> 0.2.1

* add cpp tutorials demo

* fix reviewed problem
2023-03-24 16:57:35 +08:00
WJJ1995
f0235a4c4e [Benchmark]Add inlcude_h2d_d2h config for trt (#1699)
* add GPL lisence

* add GPL-3.0 lisence

* add GPL-3.0 lisence

* add GPL-3.0 lisence

* support yolov8

* add pybind for yolov8

* add yolov8 readme

* add cpp benchmark

* add cpu and gpu mem

* public part split

* add runtime mode

* fixed bugs

* add cpu_thread_nums

* deal with comments

* deal with comments

* deal with comments

* rm useless code

* add FASTDEPLOY_DECL

* add FASTDEPLOY_DECL

* fixed for windows

* mv rss to pss

* mv rss to pss

* Update utils.cc

* use thread to collect mem

* Add ResourceUsageMonitor

* rm useless code

* fixed bug

* fixed typo

* update ResourceUsageMonitor

* fixed bug

* fixed bug

* add note for ResourceUsageMonitor

* deal with comments

* add macros

* deal with comments

* deal with comments

* deal with comments

* re-lint

* rm pmap and use mem api

* rm pmap and use mem api

* add mem api

* Add PrintBenchmarkInfo func

* Add PrintBenchmarkInfo func

* Add PrintBenchmarkInfo func

* deal with comments

* fixed enable_paddle_to_trt

* add log for paddle_trt

* support ppcls benchmark

* use new trt option api

* update benchmark info

* simplify benchmark.cc

* simplify benchmark.cc

* deal with comments

* Add ppseg && ppocr benchmark

* add OCR rec img

* add ocr benchmark

* fixed trt shape

* add trt shape

* resolve conflict

* add ENABLE_BENCHMARK define

* Add ClassifyDiff

* Add Resize for ClassifyResult

* deal with comments

* add convert info script

* resolve conflict

* Add SaveBenchmarkResult func

* fixed bug

* fixed bug

* fixed bug

* add config.txt for option

* fixed bug

* fixed bug

* fixed bug

* add benchmark.sh

* mv thread_nums from 8 to 1

* deal with comments

* deal with comments

* fixed readme

* deal with comments

* add all platform shell

* Update config.arm.txt

* Update config.gpu.txt

* Update config.x86.txt

* fixed printinfo bug

* rm proxy

* add more model support

* all backend config.txt

* deal with comments

* Add MattingDiff compare

* fixed predict bug

* adjust warmup/repeat times

* add e2e/mem configs

* fixed typo

* open collect_mem

* fixed typo

* add trt cache option

* fixed bug

* fixed repeat times

* test for benchmark

* test for det benchmark

* for benchmark

* fixed for x86

* add h2d and d2h config

* renmae txt file

---------

Co-authored-by: DefTruth <31974251+DefTruth@users.noreply.github.com>
2023-03-24 11:17:49 +08:00