DefTruth
ff835690a2
[benchmark] add max_workspace_size flags for tensorrt/pptrt backend ( #2058 )
...
* [benchmark] fixed paddlex benchmark for picodet 320
* [Bug Fix] fixed paddlex ppseg pp-trt infer error
* [Bug Fix] fixed paddlex dino benchmark trt shapes
* [benchmark] support paddlex ppyoloe pptrt benchmark
* [benchmark] adjust paddlex dino trt shapes
* [benchmark] add max_workspace_size flags for tensorrt/pptrt backend
* [benchmark] add max_workspace_size flags for tensorrt/pptrt backend
* [benchmark] add max_workspace_size flags for tensorrt/pptrt backend
---------
Co-authored-by: qiuyanjun <qiuyanjun@baidu.com >
2023-06-22 16:43:39 +08:00
DefTruth
49c033a828
[XPU] Support XPU via Paddle Inference backend ( #1987 )
...
* [backend] Support XPU via Paddle Inference backend
* [backend] Support XPU via Paddle Inference backend
* [backend] Support XPU via Paddle Inference backend
* [XPU] support XPU benchmark via paddle inference
* [XPU] support XPU benchmark via paddle inference
* [benchmark] add xpu paddle h2d config files
2023-05-25 14:13:40 +08:00
DefTruth
2672e2b881
[benchmark] optimize benchmark bin options ( #1984 )
...
* [benchmark] optimize benchmark bin options
* [benchmark] optimize benchmark bin options
2023-05-24 14:56:00 +08:00
DefTruth
1f66d5d9d3
[benchmark] support lite light api & optimize benchmark flags ( #1950 )
...
* [benchmark] support lite light api & optimize benchmark flags
* [backend] remove un-used option member
* [backend] remove un-used option member
2023-05-17 18:51:32 +08:00
thunder95
51be3fea78
[Hackthon_4th 177] Support PP-YOLOE-R with BM1684 ( #1809 )
...
* first draft
* add robx iou
* add benchmark for ppyoloe_r
* remove trash code
* fix bugs
* add pybind nms rotated option
* add missing head file
* fix bug
* fix bug2
* fix shape bug
---------
Co-authored-by: DefTruth <31974251+DefTruth@users.noreply.github.com >
2023-04-21 10:48:05 +08:00
DefTruth
6af3691568
[XPU] Update Lite XPU lib and fixed some bugs ( #1647 )
2023-03-17 21:39:39 +08:00
DefTruth
95820a9892
[Benchmark] Add GetModelResoucesNameFromDir APIs ( #1640 )
2023-03-17 17:05:24 +08:00
WJJ1995
11dd2512c5
[Benchmark] Add all backend config ( #1587 )
...
* add GPL lisence
* add GPL-3.0 lisence
* add GPL-3.0 lisence
* add GPL-3.0 lisence
* support yolov8
* add pybind for yolov8
* add yolov8 readme
* add cpp benchmark
* add cpu and gpu mem
* public part split
* add runtime mode
* fixed bugs
* add cpu_thread_nums
* deal with comments
* deal with comments
* deal with comments
* rm useless code
* add FASTDEPLOY_DECL
* add FASTDEPLOY_DECL
* fixed for windows
* mv rss to pss
* mv rss to pss
* Update utils.cc
* use thread to collect mem
* Add ResourceUsageMonitor
* rm useless code
* fixed bug
* fixed typo
* update ResourceUsageMonitor
* fixed bug
* fixed bug
* add note for ResourceUsageMonitor
* deal with comments
* add macros
* deal with comments
* deal with comments
* deal with comments
* re-lint
* rm pmap and use mem api
* rm pmap and use mem api
* add mem api
* Add PrintBenchmarkInfo func
* Add PrintBenchmarkInfo func
* Add PrintBenchmarkInfo func
* deal with comments
* fixed enable_paddle_to_trt
* add log for paddle_trt
* support ppcls benchmark
* use new trt option api
* update benchmark info
* simplify benchmark.cc
* simplify benchmark.cc
* deal with comments
* Add ppseg && ppocr benchmark
* add OCR rec img
* add ocr benchmark
* fixed trt shape
* add trt shape
* resolve conflict
* add ENABLE_BENCHMARK define
* Add ClassifyDiff
* Add Resize for ClassifyResult
* deal with comments
* add convert info script
* resolve conflict
* Add SaveBenchmarkResult func
* fixed bug
* fixed bug
* fixed bug
* add config.txt for option
* fixed bug
* fixed bug
* fixed bug
* add benchmark.sh
* mv thread_nums from 8 to 1
* deal with comments
* deal with comments
* fixed readme
* deal with comments
* add all platform shell
* Update config.arm.txt
* Update config.gpu.txt
* Update config.x86.txt
* fixed printinfo bug
* rm proxy
* add more model support
* all backend config.txt
* deal with comments
---------
Co-authored-by: DefTruth <31974251+DefTruth@users.noreply.github.com >
2023-03-13 15:36:30 +08:00
DefTruth
57decf349e
[Benchmark] Optimize log info for use_fp16 flag on CPU/XPU
2023-03-13 13:38:10 +08:00
WJJ1995
99b1bc5d6e
[Benchmark] Add run_benchmark_cpu.sh ( #1465 )
...
* add GPL lisence
* add GPL-3.0 lisence
* add GPL-3.0 lisence
* add GPL-3.0 lisence
* support yolov8
* add pybind for yolov8
* add yolov8 readme
* add cpp benchmark
* add cpu and gpu mem
* public part split
* add runtime mode
* fixed bugs
* add cpu_thread_nums
* deal with comments
* deal with comments
* deal with comments
* rm useless code
* add FASTDEPLOY_DECL
* add FASTDEPLOY_DECL
* fixed for windows
* mv rss to pss
* mv rss to pss
* Update utils.cc
* use thread to collect mem
* Add ResourceUsageMonitor
* rm useless code
* fixed bug
* fixed typo
* update ResourceUsageMonitor
* fixed bug
* fixed bug
* add note for ResourceUsageMonitor
* deal with comments
* add macros
* deal with comments
* deal with comments
* deal with comments
* re-lint
* rm pmap and use mem api
* rm pmap and use mem api
* add mem api
* Add PrintBenchmarkInfo func
* Add PrintBenchmarkInfo func
* Add PrintBenchmarkInfo func
* deal with comments
* fixed enable_paddle_to_trt
* add log for paddle_trt
* support ppcls benchmark
* use new trt option api
* update benchmark info
* simplify benchmark.cc
* simplify benchmark.cc
* deal with comments
* Add ppseg && ppocr benchmark
* add OCR rec img
* add ocr benchmark
* fixed trt shape
* add trt shape
* resolve conflict
* add ENABLE_BENCHMARK define
* Add ClassifyDiff
* Add Resize for ClassifyResult
* deal with comments
* add convert info script
* resolve conflict
* Add SaveBenchmarkResult func
* fixed bug
* fixed bug
* fixed bug
* add config.txt for option
* fixed bug
* fixed bug
* fixed bug
* add benchmark.sh
* mv thread_nums from 8 to 1
* deal with comments
* deal with comments
* fixed readme
* deal with comments
---------
Co-authored-by: DefTruth <31974251+DefTruth@users.noreply.github.com >
2023-03-02 19:11:21 +08:00
WJJ1995
fe9aff15f2
[Benchmark] Add SaveBenchmarkResult func for benchmark ( #1442 )
...
* add GPL lisence
* add GPL-3.0 lisence
* add GPL-3.0 lisence
* add GPL-3.0 lisence
* support yolov8
* add pybind for yolov8
* add yolov8 readme
* add cpp benchmark
* add cpu and gpu mem
* public part split
* add runtime mode
* fixed bugs
* add cpu_thread_nums
* deal with comments
* deal with comments
* deal with comments
* rm useless code
* add FASTDEPLOY_DECL
* add FASTDEPLOY_DECL
* fixed for windows
* mv rss to pss
* mv rss to pss
* Update utils.cc
* use thread to collect mem
* Add ResourceUsageMonitor
* rm useless code
* fixed bug
* fixed typo
* update ResourceUsageMonitor
* fixed bug
* fixed bug
* add note for ResourceUsageMonitor
* deal with comments
* add macros
* deal with comments
* deal with comments
* deal with comments
* re-lint
* rm pmap and use mem api
* rm pmap and use mem api
* add mem api
* Add PrintBenchmarkInfo func
* Add PrintBenchmarkInfo func
* Add PrintBenchmarkInfo func
* deal with comments
* fixed enable_paddle_to_trt
* add log for paddle_trt
* support ppcls benchmark
* use new trt option api
* update benchmark info
* simplify benchmark.cc
* simplify benchmark.cc
* deal with comments
* Add ppseg && ppocr benchmark
* add OCR rec img
* add ocr benchmark
* fixed trt shape
* add trt shape
* resolve conflict
* add ENABLE_BENCHMARK define
* Add ClassifyDiff
* Add Resize for ClassifyResult
* deal with comments
* add convert info script
* resolve conflict
* Add SaveBenchmarkResult func
* fixed bug
* fixed bug
* fixed bug
---------
Co-authored-by: DefTruth <31974251+DefTruth@users.noreply.github.com >
2023-02-28 11:55:22 +08:00
WJJ1995
721e6efb81
[Benchmark] Add ClassifyDiff to compare ClassifyResult diff ( #1381 )
...
* add GPL lisence
* add GPL-3.0 lisence
* add GPL-3.0 lisence
* add GPL-3.0 lisence
* support yolov8
* add pybind for yolov8
* add yolov8 readme
* add cpp benchmark
* add cpu and gpu mem
* public part split
* add runtime mode
* fixed bugs
* add cpu_thread_nums
* deal with comments
* deal with comments
* deal with comments
* rm useless code
* add FASTDEPLOY_DECL
* add FASTDEPLOY_DECL
* fixed for windows
* mv rss to pss
* mv rss to pss
* Update utils.cc
* use thread to collect mem
* Add ResourceUsageMonitor
* rm useless code
* fixed bug
* fixed typo
* update ResourceUsageMonitor
* fixed bug
* fixed bug
* add note for ResourceUsageMonitor
* deal with comments
* add macros
* deal with comments
* deal with comments
* deal with comments
* re-lint
* rm pmap and use mem api
* rm pmap and use mem api
* add mem api
* Add PrintBenchmarkInfo func
* Add PrintBenchmarkInfo func
* Add PrintBenchmarkInfo func
* deal with comments
* fixed enable_paddle_to_trt
* add log for paddle_trt
* support ppcls benchmark
* use new trt option api
* update benchmark info
* simplify benchmark.cc
* simplify benchmark.cc
* deal with comments
* Add ppseg && ppocr benchmark
* add OCR rec img
* add ocr benchmark
* fixed trt shape
* add trt shape
* resolve conflict
* add ENABLE_BENCHMARK define
* Add ClassifyDiff
* Add Resize for ClassifyResult
* deal with comments
---------
Co-authored-by: DefTruth <31974251+DefTruth@users.noreply.github.com >
2023-02-21 18:01:13 +08:00
DefTruth
42817ddc18
[Doc] Update cpp benchmark docs for CPU/GPU ( #1377 )
...
* [Benchmark] Init benchmark precision api
* [Benchmark] Init benchmark precision api
* [Benchmark] Add benchmark precision api
* [Benchmark] Calculate the statis of diff
* [Benchmark] Calculate the statis of diff
* [Benchmark] Calculate the statis of diff
* [Benchmark] Calculate the statis of diff
* [Benchmark] Calculate the statis of diff
* [Benchmark] Add SplitDataLine utils
* [Benchmark] Add LexSortByXY func
* [Benchmark] Add LexSortByXY func
* [Benchmark] Add LexSortDetectionResultByXY func
* [Benchmark] Add LexSortDetectionResultByXY func
* [Benchmark] Add tensor diff presicion test
* [Benchmark] fixed conflicts
* [Benchmark] fixed calc tensor diff
* fixed build bugs
* fixed ci bugs when WITH_TESTING=ON
* [Docs] init cpp benchmark docs
* [Doc] update cpp benchmark docs
* [Doc] update cpp benchmark docs
* [Doc] update cpp benchmark docs
* [Doc] update cpp benchmark docs
2023-02-21 15:41:37 +08:00
WJJ1995
b6658b8094
[Benchmark] Add ppocr && ppseg benchmark ( #1344 )
...
* add GPL lisence
* add GPL-3.0 lisence
* add GPL-3.0 lisence
* add GPL-3.0 lisence
* support yolov8
* add pybind for yolov8
* add yolov8 readme
* add cpp benchmark
* add cpu and gpu mem
* public part split
* add runtime mode
* fixed bugs
* add cpu_thread_nums
* deal with comments
* deal with comments
* deal with comments
* rm useless code
* add FASTDEPLOY_DECL
* add FASTDEPLOY_DECL
* fixed for windows
* mv rss to pss
* mv rss to pss
* Update utils.cc
* use thread to collect mem
* Add ResourceUsageMonitor
* rm useless code
* fixed bug
* fixed typo
* update ResourceUsageMonitor
* fixed bug
* fixed bug
* add note for ResourceUsageMonitor
* deal with comments
* add macros
* deal with comments
* deal with comments
* deal with comments
* re-lint
* rm pmap and use mem api
* rm pmap and use mem api
* add mem api
* Add PrintBenchmarkInfo func
* Add PrintBenchmarkInfo func
* Add PrintBenchmarkInfo func
* deal with comments
* fixed enable_paddle_to_trt
* add log for paddle_trt
* support ppcls benchmark
* use new trt option api
* update benchmark info
* simplify benchmark.cc
* simplify benchmark.cc
* deal with comments
* Add ppseg && ppocr benchmark
* add OCR rec img
* add ocr benchmark
* fixed trt shape
* add trt shape
* resolve conflict
* add ENABLE_BENCHMARK define
---------
Co-authored-by: DefTruth <31974251+DefTruth@users.noreply.github.com >
2023-02-20 15:59:27 +08:00
WJJ1995
da94fc46cf
[Benchmark] Support PaddleClas cpp benchmark ( #1324 )
...
* add GPL lisence
* add GPL-3.0 lisence
* add GPL-3.0 lisence
* add GPL-3.0 lisence
* support yolov8
* add pybind for yolov8
* add yolov8 readme
* add cpp benchmark
* add cpu and gpu mem
* public part split
* add runtime mode
* fixed bugs
* add cpu_thread_nums
* deal with comments
* deal with comments
* deal with comments
* rm useless code
* add FASTDEPLOY_DECL
* add FASTDEPLOY_DECL
* fixed for windows
* mv rss to pss
* mv rss to pss
* Update utils.cc
* use thread to collect mem
* Add ResourceUsageMonitor
* rm useless code
* fixed bug
* fixed typo
* update ResourceUsageMonitor
* fixed bug
* fixed bug
* add note for ResourceUsageMonitor
* deal with comments
* add macros
* deal with comments
* deal with comments
* deal with comments
* re-lint
* rm pmap and use mem api
* rm pmap and use mem api
* add mem api
* Add PrintBenchmarkInfo func
* Add PrintBenchmarkInfo func
* Add PrintBenchmarkInfo func
* deal with comments
* fixed enable_paddle_to_trt
* add log for paddle_trt
* support ppcls benchmark
* use new trt option api
* update benchmark info
* simplify benchmark.cc
* simplify benchmark.cc
* deal with comments
---------
Co-authored-by: DefTruth <31974251+DefTruth@users.noreply.github.com >
2023-02-15 17:25:49 +08:00
WJJ1995
2dfda1db85
[Benchmark] Remove pmap and use mem api ( #1309 )
...
* add GPL lisence
* add GPL-3.0 lisence
* add GPL-3.0 lisence
* add GPL-3.0 lisence
* support yolov8
* add pybind for yolov8
* add yolov8 readme
* add cpp benchmark
* add cpu and gpu mem
* public part split
* add runtime mode
* fixed bugs
* add cpu_thread_nums
* deal with comments
* deal with comments
* deal with comments
* rm useless code
* add FASTDEPLOY_DECL
* add FASTDEPLOY_DECL
* fixed for windows
* mv rss to pss
* mv rss to pss
* Update utils.cc
* use thread to collect mem
* Add ResourceUsageMonitor
* rm useless code
* fixed bug
* fixed typo
* update ResourceUsageMonitor
* fixed bug
* fixed bug
* add note for ResourceUsageMonitor
* deal with comments
* add macros
* deal with comments
* deal with comments
* deal with comments
* re-lint
* rm pmap and use mem api
* rm pmap and use mem api
* add mem api
* Add PrintBenchmarkInfo func
* Add PrintBenchmarkInfo func
* Add PrintBenchmarkInfo func
* deal with comments
---------
Co-authored-by: DefTruth <31974251+DefTruth@users.noreply.github.com >
2023-02-14 15:00:05 +08:00
WJJ1995
47b1d27fbb
[Benchmark] Add macros for benchmark ( #1301 )
...
* add GPL lisence
* add GPL-3.0 lisence
* add GPL-3.0 lisence
* add GPL-3.0 lisence
* support yolov8
* add pybind for yolov8
* add yolov8 readme
* add cpp benchmark
* add cpu and gpu mem
* public part split
* add runtime mode
* fixed bugs
* add cpu_thread_nums
* deal with comments
* deal with comments
* deal with comments
* rm useless code
* add FASTDEPLOY_DECL
* add FASTDEPLOY_DECL
* fixed for windows
* mv rss to pss
* mv rss to pss
* Update utils.cc
* use thread to collect mem
* Add ResourceUsageMonitor
* rm useless code
* fixed bug
* fixed typo
* update ResourceUsageMonitor
* fixed bug
* fixed bug
* add note for ResourceUsageMonitor
* deal with comments
* add macros
* deal with comments
* deal with comments
* deal with comments
* re-lint
---------
Co-authored-by: DefTruth <31974251+DefTruth@users.noreply.github.com >
2023-02-13 16:12:54 +08:00
WJJ1995
59a4ab343f
[Benchmark]Add ResourceUsageMonitor to collect memory info ( #1269 )
...
* add GPL lisence
* add GPL-3.0 lisence
* add GPL-3.0 lisence
* add GPL-3.0 lisence
* support yolov8
* add pybind for yolov8
* add yolov8 readme
* add cpp benchmark
* add cpu and gpu mem
* public part split
* add runtime mode
* fixed bugs
* add cpu_thread_nums
* deal with comments
* deal with comments
* deal with comments
* rm useless code
* add FASTDEPLOY_DECL
* add FASTDEPLOY_DECL
* fixed for windows
* mv rss to pss
* mv rss to pss
* Update utils.cc
* use thread to collect mem
* Add ResourceUsageMonitor
* rm useless code
* fixed bug
* fixed typo
* update ResourceUsageMonitor
* fixed bug
* fixed bug
* add note for ResourceUsageMonitor
* deal with comments
---------
Co-authored-by: DefTruth <31974251+DefTruth@users.noreply.github.com >
2023-02-10 17:13:22 +08:00
DefTruth
ce424c313e
[XPU] Add XPU option for benchmark example ( #1287 )
...
* [XPU] Add xpu option for benchmark example
* [XPU] Add fp16 flags
2023-02-10 11:24:40 +08:00
DefTruth
ab5377b5fa
[Benchmark] Add PaddleYOLOv8 cpp benchmark example & lite flags option ( #1270 )
...
* [Android] Add PaddleYOLOv8 cpp benchmark example & lite flags option
* [Benchmark] add linux x86_64 gpu benchmark build script
2023-02-09 11:58:07 +08:00
WJJ1995
66f059b65b
[Benchmark] Benchmark cpp for YOLOv5 ( #1260 )
...
* add GPL lisence
* add GPL-3.0 lisence
* add GPL-3.0 lisence
* add GPL-3.0 lisence
* support yolov8
* add pybind for yolov8
* add yolov8 readme
* add cpp benchmark
* add cpu and gpu mem
* public part split
* add runtime mode
* fixed bugs
* add cpu_thread_nums
* deal with comments
* deal with comments
* deal with comments
* rm useless code
* add FASTDEPLOY_DECL
* add FASTDEPLOY_DECL
* fixed for windows
* mv rss to pss
* mv rss to pss
* Update utils.cc
---------
Co-authored-by: DefTruth <31974251+DefTruth@users.noreply.github.com >
2023-02-08 15:49:28 +08:00
Jason
c25aa71fa9
Revert "[Benchmark]Benchmark cpp for YOLOv5" ( #1250 )
...
Revert "[Benchmark]Benchmark cpp for YOLOv5 (#1224 )"
This reverts commit c487359e33
2023-02-07 22:14:48 +08:00
WJJ1995
c487359e33
[Benchmark]Benchmark cpp for YOLOv5 ( #1224 )
...
* add GPL lisence
* add GPL-3.0 lisence
* add GPL-3.0 lisence
* add GPL-3.0 lisence
* support yolov8
* add pybind for yolov8
* add yolov8 readme
* add cpp benchmark
* add cpu and gpu mem
* public part split
* add runtime mode
* fixed bugs
* add cpu_thread_nums
* deal with comments
* deal with comments
* deal with comments
* rm useless code
* add FASTDEPLOY_DECL
* add FASTDEPLOY_DECL
2023-02-07 21:26:04 +08:00
