DefTruth
226cdda1df
[benchmark] Update benchmark cpp CMakeLists.txt ( #1432 )
...
Update benchmark cpp CMakeLists.txt
2023-02-24 11:51:19 +08:00
WJJ1995
d3845eb4e1
[Benchmark]Compare diff for OCR ( #1415 )
...
* avoid mem copy for cpp benchmark
* set CMAKE_BUILD_TYPE to Release
* Add SegmentationDiff
* change pointer to reference
* fixed bug
* cast uint8 to int32
* Add diff compare for OCR
* Add diff compare for OCR
* rm ppocr pipeline
* Add yolov5 diff compare
* Add yolov5 diff compare
* deal with comments
* deal with comments
* fixed bug
* fixed bug
2023-02-23 18:57:39 +08:00
WJJ1995
2f8d9c9a57
[Benchmark]Add SegmentationDiff to compare SegmentationResult diff ( #1404 )
...
* avoid mem copy for cpp benchmark
* set CMAKE_BUILD_TYPE to Release
* Add SegmentationDiff
* change pointer to reference
* fixed bug
* cast uint8 to int32
2023-02-22 14:42:21 +08:00
WJJ1995
721e6efb81
[Benchmark] Add ClassifyDiff to compare ClassifyResult diff ( #1381 )
...
* add GPL lisence
* add GPL-3.0 lisence
* add GPL-3.0 lisence
* add GPL-3.0 lisence
* support yolov8
* add pybind for yolov8
* add yolov8 readme
* add cpp benchmark
* add cpu and gpu mem
* public part split
* add runtime mode
* fixed bugs
* add cpu_thread_nums
* deal with comments
* deal with comments
* deal with comments
* rm useless code
* add FASTDEPLOY_DECL
* add FASTDEPLOY_DECL
* fixed for windows
* mv rss to pss
* mv rss to pss
* Update utils.cc
* use thread to collect mem
* Add ResourceUsageMonitor
* rm useless code
* fixed bug
* fixed typo
* update ResourceUsageMonitor
* fixed bug
* fixed bug
* add note for ResourceUsageMonitor
* deal with comments
* add macros
* deal with comments
* deal with comments
* deal with comments
* re-lint
* rm pmap and use mem api
* rm pmap and use mem api
* add mem api
* Add PrintBenchmarkInfo func
* Add PrintBenchmarkInfo func
* Add PrintBenchmarkInfo func
* deal with comments
* fixed enable_paddle_to_trt
* add log for paddle_trt
* support ppcls benchmark
* use new trt option api
* update benchmark info
* simplify benchmark.cc
* simplify benchmark.cc
* deal with comments
* Add ppseg && ppocr benchmark
* add OCR rec img
* add ocr benchmark
* fixed trt shape
* add trt shape
* resolve conflict
* add ENABLE_BENCHMARK define
* Add ClassifyDiff
* Add Resize for ClassifyResult
* deal with comments
---------
Co-authored-by: DefTruth <31974251+DefTruth@users.noreply.github.com >
2023-02-21 18:01:13 +08:00
DefTruth
42817ddc18
[Doc] Update cpp benchmark docs for CPU/GPU ( #1377 )
...
* [Benchmark] Init benchmark precision api
* [Benchmark] Init benchmark precision api
* [Benchmark] Add benchmark precision api
* [Benchmark] Calculate the statis of diff
* [Benchmark] Calculate the statis of diff
* [Benchmark] Calculate the statis of diff
* [Benchmark] Calculate the statis of diff
* [Benchmark] Calculate the statis of diff
* [Benchmark] Add SplitDataLine utils
* [Benchmark] Add LexSortByXY func
* [Benchmark] Add LexSortByXY func
* [Benchmark] Add LexSortDetectionResultByXY func
* [Benchmark] Add LexSortDetectionResultByXY func
* [Benchmark] Add tensor diff presicion test
* [Benchmark] fixed conflicts
* [Benchmark] fixed calc tensor diff
* fixed build bugs
* fixed ci bugs when WITH_TESTING=ON
* [Docs] init cpp benchmark docs
* [Doc] update cpp benchmark docs
* [Doc] update cpp benchmark docs
* [Doc] update cpp benchmark docs
* [Doc] update cpp benchmark docs
2023-02-21 15:41:37 +08:00
WJJ1995
b6658b8094
[Benchmark] Add ppocr && ppseg benchmark ( #1344 )
...
* add GPL lisence
* add GPL-3.0 lisence
* add GPL-3.0 lisence
* add GPL-3.0 lisence
* support yolov8
* add pybind for yolov8
* add yolov8 readme
* add cpp benchmark
* add cpu and gpu mem
* public part split
* add runtime mode
* fixed bugs
* add cpu_thread_nums
* deal with comments
* deal with comments
* deal with comments
* rm useless code
* add FASTDEPLOY_DECL
* add FASTDEPLOY_DECL
* fixed for windows
* mv rss to pss
* mv rss to pss
* Update utils.cc
* use thread to collect mem
* Add ResourceUsageMonitor
* rm useless code
* fixed bug
* fixed typo
* update ResourceUsageMonitor
* fixed bug
* fixed bug
* add note for ResourceUsageMonitor
* deal with comments
* add macros
* deal with comments
* deal with comments
* deal with comments
* re-lint
* rm pmap and use mem api
* rm pmap and use mem api
* add mem api
* Add PrintBenchmarkInfo func
* Add PrintBenchmarkInfo func
* Add PrintBenchmarkInfo func
* deal with comments
* fixed enable_paddle_to_trt
* add log for paddle_trt
* support ppcls benchmark
* use new trt option api
* update benchmark info
* simplify benchmark.cc
* simplify benchmark.cc
* deal with comments
* Add ppseg && ppocr benchmark
* add OCR rec img
* add ocr benchmark
* fixed trt shape
* add trt shape
* resolve conflict
* add ENABLE_BENCHMARK define
---------
Co-authored-by: DefTruth <31974251+DefTruth@users.noreply.github.com >
2023-02-20 15:59:27 +08:00
DefTruth
ee85a3cade
[Benchmark] Add precision evaluation api from benchmark ( #1310 )
...
* [Benchmark] Init benchmark precision api
* [Benchmark] Init benchmark precision api
* [Benchmark] Add benchmark precision api
* [Benchmark] Calculate the statis of diff
* [Benchmark] Calculate the statis of diff
* [Benchmark] Calculate the statis of diff
* [Benchmark] Calculate the statis of diff
* [Benchmark] Calculate the statis of diff
* [Benchmark] Add SplitDataLine utils
* [Benchmark] Add LexSortByXY func
* [Benchmark] Add LexSortByXY func
* [Benchmark] Add LexSortDetectionResultByXY func
* [Benchmark] Add LexSortDetectionResultByXY func
* [Benchmark] Add tensor diff presicion test
* [Benchmark] fixed conflicts
* [Benchmark] fixed calc tensor diff
* fixed build bugs
* fixed ci bugs when WITH_TESTING=ON
2023-02-16 17:16:14 +08:00
WJJ1995
da94fc46cf
[Benchmark] Support PaddleClas cpp benchmark ( #1324 )
...
* add GPL lisence
* add GPL-3.0 lisence
* add GPL-3.0 lisence
* add GPL-3.0 lisence
* support yolov8
* add pybind for yolov8
* add yolov8 readme
* add cpp benchmark
* add cpu and gpu mem
* public part split
* add runtime mode
* fixed bugs
* add cpu_thread_nums
* deal with comments
* deal with comments
* deal with comments
* rm useless code
* add FASTDEPLOY_DECL
* add FASTDEPLOY_DECL
* fixed for windows
* mv rss to pss
* mv rss to pss
* Update utils.cc
* use thread to collect mem
* Add ResourceUsageMonitor
* rm useless code
* fixed bug
* fixed typo
* update ResourceUsageMonitor
* fixed bug
* fixed bug
* add note for ResourceUsageMonitor
* deal with comments
* add macros
* deal with comments
* deal with comments
* deal with comments
* re-lint
* rm pmap and use mem api
* rm pmap and use mem api
* add mem api
* Add PrintBenchmarkInfo func
* Add PrintBenchmarkInfo func
* Add PrintBenchmarkInfo func
* deal with comments
* fixed enable_paddle_to_trt
* add log for paddle_trt
* support ppcls benchmark
* use new trt option api
* update benchmark info
* simplify benchmark.cc
* simplify benchmark.cc
* deal with comments
---------
Co-authored-by: DefTruth <31974251+DefTruth@users.noreply.github.com >
2023-02-15 17:25:49 +08:00
WJJ1995
2dfda1db85
[Benchmark] Remove pmap and use mem api ( #1309 )
...
* add GPL lisence
* add GPL-3.0 lisence
* add GPL-3.0 lisence
* add GPL-3.0 lisence
* support yolov8
* add pybind for yolov8
* add yolov8 readme
* add cpp benchmark
* add cpu and gpu mem
* public part split
* add runtime mode
* fixed bugs
* add cpu_thread_nums
* deal with comments
* deal with comments
* deal with comments
* rm useless code
* add FASTDEPLOY_DECL
* add FASTDEPLOY_DECL
* fixed for windows
* mv rss to pss
* mv rss to pss
* Update utils.cc
* use thread to collect mem
* Add ResourceUsageMonitor
* rm useless code
* fixed bug
* fixed typo
* update ResourceUsageMonitor
* fixed bug
* fixed bug
* add note for ResourceUsageMonitor
* deal with comments
* add macros
* deal with comments
* deal with comments
* deal with comments
* re-lint
* rm pmap and use mem api
* rm pmap and use mem api
* add mem api
* Add PrintBenchmarkInfo func
* Add PrintBenchmarkInfo func
* Add PrintBenchmarkInfo func
* deal with comments
---------
Co-authored-by: DefTruth <31974251+DefTruth@users.noreply.github.com >
2023-02-14 15:00:05 +08:00
WJJ1995
47b1d27fbb
[Benchmark] Add macros for benchmark ( #1301 )
...
* add GPL lisence
* add GPL-3.0 lisence
* add GPL-3.0 lisence
* add GPL-3.0 lisence
* support yolov8
* add pybind for yolov8
* add yolov8 readme
* add cpp benchmark
* add cpu and gpu mem
* public part split
* add runtime mode
* fixed bugs
* add cpu_thread_nums
* deal with comments
* deal with comments
* deal with comments
* rm useless code
* add FASTDEPLOY_DECL
* add FASTDEPLOY_DECL
* fixed for windows
* mv rss to pss
* mv rss to pss
* Update utils.cc
* use thread to collect mem
* Add ResourceUsageMonitor
* rm useless code
* fixed bug
* fixed typo
* update ResourceUsageMonitor
* fixed bug
* fixed bug
* add note for ResourceUsageMonitor
* deal with comments
* add macros
* deal with comments
* deal with comments
* deal with comments
* re-lint
---------
Co-authored-by: DefTruth <31974251+DefTruth@users.noreply.github.com >
2023-02-13 16:12:54 +08:00
WJJ1995
59a4ab343f
[Benchmark]Add ResourceUsageMonitor to collect memory info ( #1269 )
...
* add GPL lisence
* add GPL-3.0 lisence
* add GPL-3.0 lisence
* add GPL-3.0 lisence
* support yolov8
* add pybind for yolov8
* add yolov8 readme
* add cpp benchmark
* add cpu and gpu mem
* public part split
* add runtime mode
* fixed bugs
* add cpu_thread_nums
* deal with comments
* deal with comments
* deal with comments
* rm useless code
* add FASTDEPLOY_DECL
* add FASTDEPLOY_DECL
* fixed for windows
* mv rss to pss
* mv rss to pss
* Update utils.cc
* use thread to collect mem
* Add ResourceUsageMonitor
* rm useless code
* fixed bug
* fixed typo
* update ResourceUsageMonitor
* fixed bug
* fixed bug
* add note for ResourceUsageMonitor
* deal with comments
---------
Co-authored-by: DefTruth <31974251+DefTruth@users.noreply.github.com >
2023-02-10 17:13:22 +08:00
DefTruth
ce424c313e
[XPU] Add XPU option for benchmark example ( #1287 )
...
* [XPU] Add xpu option for benchmark example
* [XPU] Add fp16 flags
2023-02-10 11:24:40 +08:00
DefTruth
ab5377b5fa
[Benchmark] Add PaddleYOLOv8 cpp benchmark example & lite flags option ( #1270 )
...
* [Android] Add PaddleYOLOv8 cpp benchmark example & lite flags option
* [Benchmark] add linux x86_64 gpu benchmark build script
2023-02-09 11:58:07 +08:00
WJJ1995
66f059b65b
[Benchmark] Benchmark cpp for YOLOv5 ( #1260 )
...
* add GPL lisence
* add GPL-3.0 lisence
* add GPL-3.0 lisence
* add GPL-3.0 lisence
* support yolov8
* add pybind for yolov8
* add yolov8 readme
* add cpp benchmark
* add cpu and gpu mem
* public part split
* add runtime mode
* fixed bugs
* add cpu_thread_nums
* deal with comments
* deal with comments
* deal with comments
* rm useless code
* add FASTDEPLOY_DECL
* add FASTDEPLOY_DECL
* fixed for windows
* mv rss to pss
* mv rss to pss
* Update utils.cc
---------
Co-authored-by: DefTruth <31974251+DefTruth@users.noreply.github.com >
2023-02-08 15:49:28 +08:00
Jason
c25aa71fa9
Revert "[Benchmark]Benchmark cpp for YOLOv5" ( #1250 )
...
Revert "[Benchmark]Benchmark cpp for YOLOv5 (#1224 )"
This reverts commit c487359e33
2023-02-07 22:14:48 +08:00
WJJ1995
c487359e33
[Benchmark]Benchmark cpp for YOLOv5 ( #1224 )
...
* add GPL lisence
* add GPL-3.0 lisence
* add GPL-3.0 lisence
* add GPL-3.0 lisence
* support yolov8
* add pybind for yolov8
* add yolov8 readme
* add cpp benchmark
* add cpu and gpu mem
* public part split
* add runtime mode
* fixed bugs
* add cpu_thread_nums
* deal with comments
* deal with comments
* deal with comments
* rm useless code
* add FASTDEPLOY_DECL
* add FASTDEPLOY_DECL
2023-02-07 21:26:04 +08:00
DefTruth
a18cc0f94c
[Benchmark] remove redundant args in benchmark_ppdet ( #1238 )
...
* [backend] support bechmark mode for runtime and backend
* [backend] support bechmark mode for runtime and backend
* [pybind11] add benchmark methods pybind
* [pybind11] add benchmark methods pybind
* [Other] Update build scripts
* [Other] Update cmake/summary.cmake
* [Other] update build scripts
* [Other] add ENABLE_BENCHMARK option -> setup.py
* optimize backend time recording
* optimize backend time recording
* optimize trt backend time record
* [backend] optimze backend_time recording for trt
* [benchmark] remove redundant logs
* fixed ov_backend confilct
* [benchmark] fixed paddle_backend conflicts
* [benchmark] fixed paddle_backend conflicts
* [benchmark] fixed paddle_backend conflicts
* [benchmark] remove use_gpu option from ort backend option
* [benchmark] update benchmark_ppdet.py
* [benchmark] update benchmark_ppcls.py
* fixed lite backend conflicts
* [Lite] fixed lite xpu
* add benchmark macro
* add RUNTIME_PROFILE_LOOP macros
* add comments for RUNTIME_PROFILE macros
* add comments for new apis
* add comments for new apis
* update benchmark_ppdet.py
* afixed bugs
* remove unused codes
* optimize RUNTIME_PROFILE_LOOP macros
* optimize RUNTIME_PROFILE_LOOP macros
* add comments for benchmark option and result
* add docs for benchmark namespace
* remove redundant args in benchmark_ppdet
2023-02-07 16:37:13 +08:00
DefTruth
f73a538f61
[Backend] support bechmark mode for runtime and backend ( #1201 )
...
* [backend] support bechmark mode for runtime and backend
* [backend] support bechmark mode for runtime and backend
* [pybind11] add benchmark methods pybind
* [pybind11] add benchmark methods pybind
* [Other] Update build scripts
* [Other] Update cmake/summary.cmake
* [Other] update build scripts
* [Other] add ENABLE_BENCHMARK option -> setup.py
* optimize backend time recording
* optimize backend time recording
* optimize trt backend time record
* [backend] optimze backend_time recording for trt
* [benchmark] remove redundant logs
* fixed ov_backend confilct
* [benchmark] fixed paddle_backend conflicts
* [benchmark] fixed paddle_backend conflicts
* [benchmark] fixed paddle_backend conflicts
* [benchmark] remove use_gpu option from ort backend option
* [benchmark] update benchmark_ppdet.py
* [benchmark] update benchmark_ppcls.py
* fixed lite backend conflicts
* [Lite] fixed lite xpu
* add benchmark macro
* add RUNTIME_PROFILE_LOOP macros
* add comments for RUNTIME_PROFILE macros
* add comments for new apis
* add comments for new apis
* update benchmark_ppdet.py
* afixed bugs
* remove unused codes
* optimize RUNTIME_PROFILE_LOOP macros
* optimize RUNTIME_PROFILE_LOOP macros
* add comments for benchmark option and result
* add docs for benchmark namespace
2023-02-06 14:29:35 +08:00
DefTruth
30def02a89
[YOLOv8] Add PaddleYOLOv8 models download links ( #1152 )
...
* [Model] Support PaddleYOLOv8 model
* [YOLOv8] Add PaddleYOLOv8 pybind
* [Other] update from latest develop (#30 )
* [Backend] Remove all lite options in RuntimeOption (#1109 )
* Remove all lite options in RuntimeOption
* Fix code error
* move pybind
* Fix build error
* [Backend] Add TensorRT FP16 support for AdaptivePool2d (#1116 )
* add fp16 cuda kernel
* fix code bug
* update code
* [Doc] Fix KunlunXin doc (#1139 )
fix kunlunxin doc
* [Model] Support PaddleYOLOv8 model (#1136 )
Co-authored-by: Jason <jiangjiajun@baidu.com >
Co-authored-by: yeliang2258 <30516196+yeliang2258@users.noreply.github.com >
* [YOLOv8] add PaddleYOLOv8 pybind11 (#1144 ) (#31 )
* [Model] Support PaddleYOLOv8 model
* [YOLOv8] Add PaddleYOLOv8 pybind
* [Other] update from latest develop (#30 )
* [Backend] Remove all lite options in RuntimeOption (#1109 )
* Remove all lite options in RuntimeOption
* Fix code error
* move pybind
* Fix build error
* [Backend] Add TensorRT FP16 support for AdaptivePool2d (#1116 )
* add fp16 cuda kernel
* fix code bug
* update code
* [Doc] Fix KunlunXin doc (#1139 )
fix kunlunxin doc
* [Model] Support PaddleYOLOv8 model (#1136 )
Co-authored-by: Jason <jiangjiajun@baidu.com >
Co-authored-by: yeliang2258 <30516196+yeliang2258@users.noreply.github.com >
Co-authored-by: Jason <jiangjiajun@baidu.com >
Co-authored-by: yeliang2258 <30516196+yeliang2258@users.noreply.github.com >
Co-authored-by: Jason <jiangjiajun@baidu.com >
Co-authored-by: yeliang2258 <30516196+yeliang2258@users.noreply.github.com >
* [benchmark] add PaddleYOLOv8 -> benchmark
* [benchmark] add PaddleYOLOv8 -> benchmark
* [Lite] Support PaddleYOLOv8 with Lite Backend
* [Pick] Update from latest develop (#32 )
* [Model] Support Insightface model inferenceing on RKNPU (#1113 )
* 更新交叉编译
* 更新交叉编译
* 更新交叉编译
* 更新交叉编译
* 更新交叉编译
* 更新交叉编译
* 更新交叉编译
* 更新交叉编译
* 更新交叉编译
* Update issues.md
* Update fastdeploy_init.sh
* 更新交叉编译
* 更新insightface系列模型的rknpu2支持
* 更新insightface系列模型的rknpu2支持
* 更新说明文档
* 更新insightface
* 尝试解决pybind问题
Co-authored-by: Jason <928090362@qq.com >
Co-authored-by: Jason <jiangjiajun@baidu.com >
* [Other] Add Function For Aligning Face With Five Points (#1124 )
* 更新5点人脸对齐的代码
* 更新代码格式
* 解决comment
* update example
* 更新注释
Co-authored-by: DefTruth <31974251+DefTruth@users.noreply.github.com >
* [Lite] Support PaddleYOLOv8 with Lite Backend (#1145 )
* [Model] Support PaddleYOLOv8 model
* [YOLOv8] Add PaddleYOLOv8 pybind
* [Other] update from latest develop (#30 )
* [Backend] Remove all lite options in RuntimeOption (#1109 )
* Remove all lite options in RuntimeOption
* Fix code error
* move pybind
* Fix build error
* [Backend] Add TensorRT FP16 support for AdaptivePool2d (#1116 )
* add fp16 cuda kernel
* fix code bug
* update code
* [Doc] Fix KunlunXin doc (#1139 )
fix kunlunxin doc
* [Model] Support PaddleYOLOv8 model (#1136 )
Co-authored-by: Jason <jiangjiajun@baidu.com >
Co-authored-by: yeliang2258 <30516196+yeliang2258@users.noreply.github.com >
* [YOLOv8] add PaddleYOLOv8 pybind11 (#1144 ) (#31 )
* [Model] Support PaddleYOLOv8 model
* [YOLOv8] Add PaddleYOLOv8 pybind
* [Other] update from latest develop (#30 )
* [Backend] Remove all lite options in RuntimeOption (#1109 )
* Remove all lite options in RuntimeOption
* Fix code error
* move pybind
* Fix build error
* [Backend] Add TensorRT FP16 support for AdaptivePool2d (#1116 )
* add fp16 cuda kernel
* fix code bug
* update code
* [Doc] Fix KunlunXin doc (#1139 )
fix kunlunxin doc
* [Model] Support PaddleYOLOv8 model (#1136 )
Co-authored-by: Jason <jiangjiajun@baidu.com >
Co-authored-by: yeliang2258 <30516196+yeliang2258@users.noreply.github.com >
Co-authored-by: Jason <jiangjiajun@baidu.com >
Co-authored-by: yeliang2258 <30516196+yeliang2258@users.noreply.github.com >
Co-authored-by: Jason <jiangjiajun@baidu.com >
Co-authored-by: yeliang2258 <30516196+yeliang2258@users.noreply.github.com >
* [benchmark] add PaddleYOLOv8 -> benchmark
* [benchmark] add PaddleYOLOv8 -> benchmark
* [Lite] Support PaddleYOLOv8 with Lite Backend
Co-authored-by: Jason <jiangjiajun@baidu.com >
Co-authored-by: yeliang2258 <30516196+yeliang2258@users.noreply.github.com >
* [Model] Add Silero VAD example (#1107 )
* add vad example
* fix typo
* fix typo
* rename file
* remove model and wav
* delete Vad.cc
* delete Vad.h
* rename and format
* fix max and min
* update readme
* rename var
* format
* add params
* update readme
* update readme
* Update README.md
* Update README_CN.md
Co-authored-by: DefTruth <31974251+DefTruth@users.noreply.github.com >
Co-authored-by: Zheng-Bicheng <58363586+Zheng-Bicheng@users.noreply.github.com >
Co-authored-by: Jason <928090362@qq.com >
Co-authored-by: Jason <jiangjiajun@baidu.com >
Co-authored-by: yeliang2258 <30516196+yeliang2258@users.noreply.github.com >
Co-authored-by: Qianhe Chen <54462604+chenqianhe@users.noreply.github.com >
* [YOLOv8] Support PaddleYOLOv8 on Kunlunxin&Ascend
* [YOLOv8] Add PaddleYOLOv8 model download links
* [YOLOv8] Add PaddleYOLOv8 Box AP
Co-authored-by: Jason <jiangjiajun@baidu.com >
Co-authored-by: yeliang2258 <30516196+yeliang2258@users.noreply.github.com >
Co-authored-by: Zheng-Bicheng <58363586+Zheng-Bicheng@users.noreply.github.com >
Co-authored-by: Jason <928090362@qq.com >
Co-authored-by: Qianhe Chen <54462604+chenqianhe@users.noreply.github.com >
2023-01-16 13:15:24 +08:00
DefTruth
f969967179
[Lite] Support PaddleYOLOv8 with Lite Backend ( #1145 )
...
* [Model] Support PaddleYOLOv8 model
* [YOLOv8] Add PaddleYOLOv8 pybind
* [Other] update from latest develop (#30 )
* [Backend] Remove all lite options in RuntimeOption (#1109 )
* Remove all lite options in RuntimeOption
* Fix code error
* move pybind
* Fix build error
* [Backend] Add TensorRT FP16 support for AdaptivePool2d (#1116 )
* add fp16 cuda kernel
* fix code bug
* update code
* [Doc] Fix KunlunXin doc (#1139 )
fix kunlunxin doc
* [Model] Support PaddleYOLOv8 model (#1136 )
Co-authored-by: Jason <jiangjiajun@baidu.com >
Co-authored-by: yeliang2258 <30516196+yeliang2258@users.noreply.github.com >
* [YOLOv8] add PaddleYOLOv8 pybind11 (#1144 ) (#31 )
* [Model] Support PaddleYOLOv8 model
* [YOLOv8] Add PaddleYOLOv8 pybind
* [Other] update from latest develop (#30 )
* [Backend] Remove all lite options in RuntimeOption (#1109 )
* Remove all lite options in RuntimeOption
* Fix code error
* move pybind
* Fix build error
* [Backend] Add TensorRT FP16 support for AdaptivePool2d (#1116 )
* add fp16 cuda kernel
* fix code bug
* update code
* [Doc] Fix KunlunXin doc (#1139 )
fix kunlunxin doc
* [Model] Support PaddleYOLOv8 model (#1136 )
Co-authored-by: Jason <jiangjiajun@baidu.com >
Co-authored-by: yeliang2258 <30516196+yeliang2258@users.noreply.github.com >
Co-authored-by: Jason <jiangjiajun@baidu.com >
Co-authored-by: yeliang2258 <30516196+yeliang2258@users.noreply.github.com >
Co-authored-by: Jason <jiangjiajun@baidu.com >
Co-authored-by: yeliang2258 <30516196+yeliang2258@users.noreply.github.com >
* [benchmark] add PaddleYOLOv8 -> benchmark
* [benchmark] add PaddleYOLOv8 -> benchmark
* [Lite] Support PaddleYOLOv8 with Lite Backend
Co-authored-by: Jason <jiangjiajun@baidu.com >
Co-authored-by: yeliang2258 <30516196+yeliang2258@users.noreply.github.com >
2023-01-14 20:44:10 +08:00
zhoushunjie
cefdadf5e2
Update backend name
2022-12-29 11:09:26 +00:00
zhoushunjie
34aebb1de3
Fix cpu_num_thread->cpu_num_threads
2022-12-29 10:53:25 +00:00
zhoushunjie
51e346ea09
Update uie benchmark output
2022-12-29 10:29:32 +00:00
zhoushunjie
4f7233c11f
update uie benchmark
2022-12-29 08:26:32 +00:00
zhoushunjie
2ac94e91be
fix trt dy shape
2022-12-29 08:26:32 +00:00
zhoushunjie
3017ec487c
Add uie benchmark
2022-12-29 08:26:32 +00:00
WJJ1995
4715ddba84
[Benchmark] Support YOLO series in Paddle Format ( #958 )
...
* add onnx_ort_runtime demo
* rm in requirements
* support batch eval
* fixed MattingResults bug
* move assignment for DetectionResult
* integrated x2paddle
* add model convert readme
* update readme
* re-lint
* add processor api
* Add MattingResult Free
* change valid_cpu_backends order
* add ppocr benchmark
* mv bs from 64 to 32
* fixed quantize.md
* fixed quantize bugs
* Add Monitor for benchmark
* update mem monitor
* Set trt_max_batch_size default 1
* fixed ocr benchmark bug
* support yolov5 in serving
* Fixed yolov5 serving
* Fixed postprocess
* update yolov5 to 7.0
* add poros runtime demos
* update readme
* Support poros abi=1
* rm useless note
* deal with comments
* support pp_trt for ppseg
* fixed symlink problem
* Add is_mini_pad and stride for yolov5
* Add yolo series for paddle format
* fixed bugs
* fixed bug
Co-authored-by: Jason <jiangjiajun@baidu.com >
2022-12-25 16:27:50 +08:00
WJJ1995
5e350655f0
[Benchmark] Support paddle_trt for ppseg benchmark ( #927 )
...
* add onnx_ort_runtime demo
* rm in requirements
* support batch eval
* fixed MattingResults bug
* move assignment for DetectionResult
* integrated x2paddle
* add model convert readme
* update readme
* re-lint
* add processor api
* Add MattingResult Free
* change valid_cpu_backends order
* add ppocr benchmark
* mv bs from 64 to 32
* fixed quantize.md
* fixed quantize bugs
* Add Monitor for benchmark
* update mem monitor
* Set trt_max_batch_size default 1
* fixed ocr benchmark bug
* support yolov5 in serving
* Fixed yolov5 serving
* Fixed postprocess
* update yolov5 to 7.0
* add poros runtime demos
* update readme
* Support poros abi=1
* rm useless note
* deal with comments
* support pp_trt for ppseg
* fixed symlink problem
Co-authored-by: Jason <jiangjiajun@baidu.com >
2022-12-21 10:12:54 +08:00
WJJ1995
7415552cb2
[Benchmark] Fixed benchmark_ppocr.py ( #859 )
...
* add onnx_ort_runtime demo
* rm in requirements
* support batch eval
* fixed MattingResults bug
* move assignment for DetectionResult
* integrated x2paddle
* add model convert readme
* update readme
* re-lint
* add processor api
* Add MattingResult Free
* change valid_cpu_backends order
* add ppocr benchmark
* mv bs from 64 to 32
* fixed quantize.md
* fixed quantize bugs
* Add Monitor for benchmark
* update mem monitor
* Set trt_max_batch_size default 1
* fixed ocr benchmark bug
Co-authored-by: Jason <jiangjiajun@baidu.com >
2022-12-12 18:34:52 +08:00
WJJ1995
8e13a38bf5
[Backend] Modify trt_max_batch_size the default value to 1 ( #817 )
...
* add onnx_ort_runtime demo
* rm in requirements
* support batch eval
* fixed MattingResults bug
* move assignment for DetectionResult
* integrated x2paddle
* add model convert readme
* update readme
* re-lint
* add processor api
* Add MattingResult Free
* change valid_cpu_backends order
* add ppocr benchmark
* mv bs from 64 to 32
* fixed quantize.md
* fixed quantize bugs
* Add Monitor for benchmark
* update mem monitor
* Set trt_max_batch_size default 1
Co-authored-by: Jason <jiangjiajun@baidu.com >
2022-12-11 14:16:37 +08:00
WJJ1995
e6af8f2334
[Benchmark] Update the hardware monitoring method through Monitor class ( #808 )
...
* add onnx_ort_runtime demo
* rm in requirements
* support batch eval
* fixed MattingResults bug
* move assignment for DetectionResult
* integrated x2paddle
* add model convert readme
* update readme
* re-lint
* add processor api
* Add MattingResult Free
* change valid_cpu_backends order
* add ppocr benchmark
* mv bs from 64 to 32
* fixed quantize.md
* fixed quantize bugs
* Add Monitor for benchmark
* update mem monitor
Co-authored-by: Jason <jiangjiajun@baidu.com >
2022-12-07 13:38:01 +08:00
WJJ1995
ea0bac4061
[Benchmark] Add GPU OpenVIVO Option in benchmark ( #786 )
...
* add paddle_trt in benchmark
* update benchmark in device
* update benchmark
* update result doc
* fixed for CI
* update python api_docs
* update index.rst
* add runtime cpp examples
* deal with comments
* Update infer_paddle_tensorrt.py
* Add runtime quick start
* deal with comments
* fixed reused_input_tensors&&reused_output_tensors
* fixed docs
* fixed headpose typo
* fixed typo
* refactor yolov5
* update model infer
* refactor pybind for yolov5
* rm origin yolov5
* fixed bugs
* rm cuda preprocess
* fixed bugs
* fixed bugs
* fixed bug
* fixed bug
* fix pybind
* rm useless code
* add convert_and_permute
* fixed bugs
* fixed im_info for bs_predict
* fixed bug
* add bs_predict for yolov5
* Add runtime test and batch eval
* deal with comments
* fixed bug
* update testcase
* fixed batch eval bug
* fixed preprocess bug
* refactor yolov7
* add yolov7 testcase
* rm resize_after_load and add is_scale_up
* fixed bug
* set multi_label true
* optimize rvm preprocess
* optimizer rvm postprocess
* fixed bug
* deal with comments
* fixed bugs
* add gpu ov for benchmark
Co-authored-by: Jason <928090362@qq.com >
Co-authored-by: Jason <jiangjiajun@baidu.com >
2022-12-05 10:51:13 +08:00
WJJ1995
1860d3ab78
[Benchmark] Add PPOCR benchmark ( #771 )
...
* add onnx_ort_runtime demo
* rm in requirements
* support batch eval
* fixed MattingResults bug
* move assignment for DetectionResult
* integrated x2paddle
* add model convert readme
* update readme
* re-lint
* add processor api
* Add MattingResult Free
* change valid_cpu_backends order
* add ppocr benchmark
* mv bs from 64 to 32
Co-authored-by: Jason <jiangjiajun@baidu.com >
2022-12-05 10:06:41 +08:00
Jack Zhou
c2533f1f75
[Benchmark] Add benchmark for ernie sequence classification ( #444 )
...
* Add benchmark for ernie sequence classification
* Add pretty print
* Update benchmark of ernie
* get_table -> get_statistics_table
* add comments
* Update the output
* Add cpu gpu memory statitis
* Add gpu utilization sampling
Co-authored-by: Jason <jiangjiajun@baidu.com >
2022-11-15 11:25:32 +08:00
WJJ1995
4bbfd977c7
[Other] Add onnx_ort_runtime cpp/python demos ( #565 )
...
* add onnx_ort_runtime demo
* rm in requirements
2022-11-11 12:47:06 +08:00
WJJ1995
1db85e0ad9
[Benchmark] Update benchmark ( #488 )
...
* add paddle_trt in benchmark
* update benchmark in device
* update benchmark
2022-11-03 11:23:03 +08:00
WJJ1995
3fbfee0710
[Benchmark] Update benchmark build_option ( #485 )
...
* add paddle_trt in benchmark
* update benchmark in device
2022-11-02 20:41:40 +08:00
WJJ1995
8602c7c2aa
[Benchmark] Add paddle_trt in benchmark ( #476 )
...
add paddle_trt in benchmark
2022-11-01 22:05:30 +08:00
leiqing
be1aa2c969
Update README.md
2022-10-31 10:52:32 +08:00
leiqing
36670cad22
Update README.md
2022-10-31 10:50:50 +08:00
Jason
583f16afc1
Update README.md
2022-10-27 09:49:24 +08:00
ChaoII
ba501fd963
[Model] add pptracking model ( #357 )
...
* add override mark
* delete some
* recovery
* recovery
* add tracking
* add tracking py_bind and example
* add pptracking
* add pptracking
* iomanip head file
* add opencv_video lib
* add python libs package
Signed-off-by: ChaoII <849453582@qq.com >
* complete comments
Signed-off-by: ChaoII <849453582@qq.com >
* add jdeTracker_ member variable
Signed-off-by: ChaoII <849453582@qq.com >
* add 'FASTDEPLOY_DECL' macro
Signed-off-by: ChaoII <849453582@qq.com >
* remove kwargs params
Signed-off-by: ChaoII <849453582@qq.com >
* [Doc]update pptracking docs
* delete 'ENABLE_PADDLE_FRONTEND' switch
* add pptracking unit test
* update pptracking unit test
Signed-off-by: ChaoII <849453582@qq.com >
* modify test video file path and remove trt test
* update unit test model url
* remove 'FASTDEPLOY_DECL' macro
Signed-off-by: ChaoII <849453582@qq.com >
* fix build python packages about pptracking on win32
Signed-off-by: ChaoII <849453582@qq.com >
Signed-off-by: ChaoII <849453582@qq.com >
Co-authored-by: Jason <jiangjiajun@baidu.com >
2022-10-26 14:27:55 +08:00
WJJ1995
4d2fbcb030
Add Benchmark readme ( #236 )
...
* add ppcls benchmark
* add ppcls benchmark
* add ppcls benchmark
* add ppcls benchmark
* fixed txt path
* resolve conflict
* resolve conflict
* deal with comments
* Add enable_trt_fp16 option
* Add OV backend for seg and det
* fixed valid backends in ppdet
* fixed valid backends in yolo
* add copyright and rm Chinese Notes
* add ppdet&ppseg&yolo benchmark
* add cpu/gpu mem info
* Add benchmark readme
* fixed bug
Co-authored-by: Jason <jiangjiajun@baidu.com >
2022-09-15 21:36:10 +08:00
WJJ1995
06908b8beb
Add Benchmark test ( #200 )
...
* add ppcls benchmark
* add ppcls benchmark
* add ppcls benchmark
* add ppcls benchmark
* fixed txt path
* resolve conflict
* resolve conflict
* deal with comments
* Add enable_trt_fp16 option
* Add OV backend for seg and det
* fixed valid backends in ppdet
* fixed valid backends in yolo
* add copyright and rm Chinese Notes
* add ppdet&ppseg&yolo benchmark
* add cpu/gpu mem info
Co-authored-by: Jason <jiangjiajun@baidu.com >
2022-09-14 20:15:01 +08:00
ziqi-jin
4bf0d3847a
Add Benchmark script for PPClas models ( #187 )
...
* first commit for yolov7
* pybind for yolov7
* CPP README.md
* CPP README.md
* modified yolov7.cc
* README.md
* python file modify
* delete license in fastdeploy/
* repush the conflict part
* README.md modified
* README.md modified
* file path modified
* file path modified
* file path modified
* file path modified
* file path modified
* README modified
* README modified
* move some helpers to private
* add examples for yolov7
* api.md modified
* api.md modified
* api.md modified
* YOLOv7
* yolov7 release link
* yolov7 release link
* yolov7 release link
* copyright
* change some helpers to private
* change variables to const and fix documents.
* gitignore
* Transfer some funtions to private member of class
* Transfer some funtions to private member of class
* Merge from develop (#9 )
* Fix compile problem in different python version (#26 )
* fix some usage problem in linux
* Fix compile problem
Co-authored-by: root <root@bjyz-sys-gpu-kongming3.bjyz.baidu.com >
* Add PaddleDetetion/PPYOLOE model support (#22 )
* add ppdet/ppyoloe
* Add demo code and documents
* add convert processor to vision (#27 )
* update .gitignore
* Added checking for cmake include dir
* fixed missing trt_backend option bug when init from trt
* remove un-need data layout and add pre-check for dtype
* changed RGB2BRG to BGR2RGB in ppcls model
* add model_zoo yolov6 c++/python demo
* fixed CMakeLists.txt typos
* update yolov6 cpp/README.md
* add yolox c++/pybind and model_zoo demo
* move some helpers to private
* fixed CMakeLists.txt typos
* add normalize with alpha and beta
* add version notes for yolov5/yolov6/yolox
* add copyright to yolov5.cc
* revert normalize
* fixed some bugs in yolox
* fixed examples/CMakeLists.txt to avoid conflicts
* add convert processor to vision
* format examples/CMakeLists summary
* Fix bug while the inference result is empty with YOLOv5 (#29 )
* Add multi-label function for yolov5
* Update README.md
Update doc
* Update fastdeploy_runtime.cc
fix variable option.trt_max_shape wrong name
* Update runtime_option.md
Update resnet model dynamic shape setting name from images to x
* Fix bug when inference result boxes are empty
* Delete detection.py
Co-authored-by: Jason <jiangjiajun@baidu.com >
Co-authored-by: root <root@bjyz-sys-gpu-kongming3.bjyz.baidu.com >
Co-authored-by: DefTruth <31974251+DefTruth@users.noreply.github.com >
Co-authored-by: huangjianhui <852142024@qq.com >
* first commit for yolor
* for merge
* Develop (#11 )
* Fix compile problem in different python version (#26 )
* fix some usage problem in linux
* Fix compile problem
Co-authored-by: root <root@bjyz-sys-gpu-kongming3.bjyz.baidu.com >
* Add PaddleDetetion/PPYOLOE model support (#22 )
* add ppdet/ppyoloe
* Add demo code and documents
* add convert processor to vision (#27 )
* update .gitignore
* Added checking for cmake include dir
* fixed missing trt_backend option bug when init from trt
* remove un-need data layout and add pre-check for dtype
* changed RGB2BRG to BGR2RGB in ppcls model
* add model_zoo yolov6 c++/python demo
* fixed CMakeLists.txt typos
* update yolov6 cpp/README.md
* add yolox c++/pybind and model_zoo demo
* move some helpers to private
* fixed CMakeLists.txt typos
* add normalize with alpha and beta
* add version notes for yolov5/yolov6/yolox
* add copyright to yolov5.cc
* revert normalize
* fixed some bugs in yolox
* fixed examples/CMakeLists.txt to avoid conflicts
* add convert processor to vision
* format examples/CMakeLists summary
* Fix bug while the inference result is empty with YOLOv5 (#29 )
* Add multi-label function for yolov5
* Update README.md
Update doc
* Update fastdeploy_runtime.cc
fix variable option.trt_max_shape wrong name
* Update runtime_option.md
Update resnet model dynamic shape setting name from images to x
* Fix bug when inference result boxes are empty
* Delete detection.py
Co-authored-by: Jason <jiangjiajun@baidu.com >
Co-authored-by: root <root@bjyz-sys-gpu-kongming3.bjyz.baidu.com >
Co-authored-by: DefTruth <31974251+DefTruth@users.noreply.github.com >
Co-authored-by: huangjianhui <852142024@qq.com >
* Yolor (#16 )
* Develop (#11 ) (#12 )
* Fix compile problem in different python version (#26 )
* fix some usage problem in linux
* Fix compile problem
Co-authored-by: root <root@bjyz-sys-gpu-kongming3.bjyz.baidu.com >
* Add PaddleDetetion/PPYOLOE model support (#22 )
* add ppdet/ppyoloe
* Add demo code and documents
* add convert processor to vision (#27 )
* update .gitignore
* Added checking for cmake include dir
* fixed missing trt_backend option bug when init from trt
* remove un-need data layout and add pre-check for dtype
* changed RGB2BRG to BGR2RGB in ppcls model
* add model_zoo yolov6 c++/python demo
* fixed CMakeLists.txt typos
* update yolov6 cpp/README.md
* add yolox c++/pybind and model_zoo demo
* move some helpers to private
* fixed CMakeLists.txt typos
* add normalize with alpha and beta
* add version notes for yolov5/yolov6/yolox
* add copyright to yolov5.cc
* revert normalize
* fixed some bugs in yolox
* fixed examples/CMakeLists.txt to avoid conflicts
* add convert processor to vision
* format examples/CMakeLists summary
* Fix bug while the inference result is empty with YOLOv5 (#29 )
* Add multi-label function for yolov5
* Update README.md
Update doc
* Update fastdeploy_runtime.cc
fix variable option.trt_max_shape wrong name
* Update runtime_option.md
Update resnet model dynamic shape setting name from images to x
* Fix bug when inference result boxes are empty
* Delete detection.py
Co-authored-by: Jason <jiangjiajun@baidu.com >
Co-authored-by: root <root@bjyz-sys-gpu-kongming3.bjyz.baidu.com >
Co-authored-by: DefTruth <31974251+DefTruth@users.noreply.github.com >
Co-authored-by: huangjianhui <852142024@qq.com >
Co-authored-by: Jason <jiangjiajun@baidu.com >
Co-authored-by: root <root@bjyz-sys-gpu-kongming3.bjyz.baidu.com >
Co-authored-by: DefTruth <31974251+DefTruth@users.noreply.github.com >
Co-authored-by: huangjianhui <852142024@qq.com >
* Develop (#13 )
* Fix compile problem in different python version (#26 )
* fix some usage problem in linux
* Fix compile problem
Co-authored-by: root <root@bjyz-sys-gpu-kongming3.bjyz.baidu.com >
* Add PaddleDetetion/PPYOLOE model support (#22 )
* add ppdet/ppyoloe
* Add demo code and documents
* add convert processor to vision (#27 )
* update .gitignore
* Added checking for cmake include dir
* fixed missing trt_backend option bug when init from trt
* remove un-need data layout and add pre-check for dtype
* changed RGB2BRG to BGR2RGB in ppcls model
* add model_zoo yolov6 c++/python demo
* fixed CMakeLists.txt typos
* update yolov6 cpp/README.md
* add yolox c++/pybind and model_zoo demo
* move some helpers to private
* fixed CMakeLists.txt typos
* add normalize with alpha and beta
* add version notes for yolov5/yolov6/yolox
* add copyright to yolov5.cc
* revert normalize
* fixed some bugs in yolox
* fixed examples/CMakeLists.txt to avoid conflicts
* add convert processor to vision
* format examples/CMakeLists summary
* Fix bug while the inference result is empty with YOLOv5 (#29 )
* Add multi-label function for yolov5
* Update README.md
Update doc
* Update fastdeploy_runtime.cc
fix variable option.trt_max_shape wrong name
* Update runtime_option.md
Update resnet model dynamic shape setting name from images to x
* Fix bug when inference result boxes are empty
* Delete detection.py
Co-authored-by: Jason <jiangjiajun@baidu.com >
Co-authored-by: root <root@bjyz-sys-gpu-kongming3.bjyz.baidu.com >
Co-authored-by: DefTruth <31974251+DefTruth@users.noreply.github.com >
Co-authored-by: huangjianhui <852142024@qq.com >
* documents
* documents
* documents
* documents
* documents
* documents
* documents
* documents
* documents
* documents
* documents
* documents
* Develop (#14 )
* Fix compile problem in different python version (#26 )
* fix some usage problem in linux
* Fix compile problem
Co-authored-by: root <root@bjyz-sys-gpu-kongming3.bjyz.baidu.com >
* Add PaddleDetetion/PPYOLOE model support (#22 )
* add ppdet/ppyoloe
* Add demo code and documents
* add convert processor to vision (#27 )
* update .gitignore
* Added checking for cmake include dir
* fixed missing trt_backend option bug when init from trt
* remove un-need data layout and add pre-check for dtype
* changed RGB2BRG to BGR2RGB in ppcls model
* add model_zoo yolov6 c++/python demo
* fixed CMakeLists.txt typos
* update yolov6 cpp/README.md
* add yolox c++/pybind and model_zoo demo
* move some helpers to private
* fixed CMakeLists.txt typos
* add normalize with alpha and beta
* add version notes for yolov5/yolov6/yolox
* add copyright to yolov5.cc
* revert normalize
* fixed some bugs in yolox
* fixed examples/CMakeLists.txt to avoid conflicts
* add convert processor to vision
* format examples/CMakeLists summary
* Fix bug while the inference result is empty with YOLOv5 (#29 )
* Add multi-label function for yolov5
* Update README.md
Update doc
* Update fastdeploy_runtime.cc
fix variable option.trt_max_shape wrong name
* Update runtime_option.md
Update resnet model dynamic shape setting name from images to x
* Fix bug when inference result boxes are empty
* Delete detection.py
Co-authored-by: root <root@bjyz-sys-gpu-kongming3.bjyz.baidu.com >
Co-authored-by: DefTruth <31974251+DefTruth@users.noreply.github.com >
Co-authored-by: huangjianhui <852142024@qq.com >
Co-authored-by: Jason <jiangjiajun@baidu.com >
Co-authored-by: root <root@bjyz-sys-gpu-kongming3.bjyz.baidu.com >
Co-authored-by: DefTruth <31974251+DefTruth@users.noreply.github.com >
Co-authored-by: huangjianhui <852142024@qq.com >
Co-authored-by: Jason <928090362@qq.com >
* add is_dynamic for YOLO series (#22 )
* git test
* benchmark for ppclas
* retrigger ci
Co-authored-by: Jason <jiangjiajun@baidu.com >
Co-authored-by: root <root@bjyz-sys-gpu-kongming3.bjyz.baidu.com >
Co-authored-by: DefTruth <31974251+DefTruth@users.noreply.github.com >
Co-authored-by: huangjianhui <852142024@qq.com >
Co-authored-by: Jason <928090362@qq.com >
Co-authored-by: ziqi-jin <>
2022-09-05 20:44:25 +08:00
