[Benchmark] Add all backend config (#1587)

* add GPL lisence

* add GPL-3.0 lisence

* add GPL-3.0 lisence

* add GPL-3.0 lisence

* support yolov8

* add pybind for yolov8

* add yolov8 readme

* add cpp benchmark

* add cpu and gpu mem

* public part split

* add runtime mode

* fixed bugs

* add cpu_thread_nums

* deal with comments

* deal with comments

* deal with comments

* rm useless code

* add FASTDEPLOY_DECL

* add FASTDEPLOY_DECL

* fixed for windows

* mv rss to pss

* mv rss to pss

* Update utils.cc

* use thread to collect mem

* Add ResourceUsageMonitor

* rm useless code

* fixed bug

* fixed typo

* update ResourceUsageMonitor

* fixed bug

* fixed bug

* add note for ResourceUsageMonitor

* deal with comments

* add macros

* deal with comments

* deal with comments

* deal with comments

* re-lint

* rm pmap and use mem api

* rm pmap and use mem api

* add mem api

* Add PrintBenchmarkInfo func

* Add PrintBenchmarkInfo func

* Add PrintBenchmarkInfo func

* deal with comments

* fixed enable_paddle_to_trt

* add log for paddle_trt

* support ppcls benchmark

* use new trt option api

* update benchmark info

* simplify benchmark.cc

* simplify benchmark.cc

* deal with comments

* Add ppseg && ppocr benchmark

* add OCR rec img

* add ocr benchmark

* fixed trt shape

* add trt shape

* resolve conflict

* add ENABLE_BENCHMARK define

* Add ClassifyDiff

* Add Resize for ClassifyResult

* deal with comments

* add convert info script

* resolve conflict

* Add SaveBenchmarkResult func

* fixed bug

* fixed bug

* fixed bug

* add config.txt for option

* fixed bug

* fixed bug

* fixed bug

* add benchmark.sh

* mv thread_nums from 8 to 1

* deal with comments

* deal with comments

* fixed readme

* deal with comments

* add all platform shell

* Update config.arm.txt

* Update config.gpu.txt

* Update config.x86.txt

* fixed printinfo bug

* rm proxy

* add more model support

* all backend config.txt

* deal with comments

---------

Co-authored-by: DefTruth <31974251+DefTruth@users.noreply.github.com>

benchmark/cpp/README.md

@@ -116,18 +116,33 @@ tar -zxvf yolov8_s_500e_coco.tgz
 在准备好相关的环境配置和SDK后，可以使用本目录提供的脚本一键运行后的benchmark数据。
 - 获取模型和资源文件  
 ```bash
-./get_models.sh 
+./get_models.sh
 ```  
 - 运行benchmark脚本  
-```bash  
-# x86 CPU
-./benchmark_x86.sh
-# Arm CPU
-./benchmark_arm.sh
-# NVIDIA GPU
-./benchmark_gpu.sh
-# XPU
-./benchmark_xpu.sh
+```bash
+# x86 CPU Paddle backend fp32
+./benchmark_x86.sh config/config.x86.paddle.fp32.txt
+# x86 CPU ONNXRuntime backend fp32
+./benchmark_x86.sh config/config.x86.ort.fp32.txt
+# x86 CPU OpenVIVO backend fp32
+./benchmark_x86.sh config/config.x86.ov.fp32.txt
+# NVIDIA GPU Paddle backend fp32
+./benchmark_gpu.sh config/config.gpu.paddle.fp32.txt
+# NVIDIA GPU ONNXRuntime backend fp32
+./benchmark_gpu.sh config/config.gpu.ort.fp32.txt
+# NVIDIA GPU Paddle_trt backend fp32
+./benchmark_gpu_trt.sh config/config.gpu.paddle_trt.fp32.txt
+# NVIDIA GPU Paddle_trt backend fp16
+./benchmark_gpu_trt.sh config/config.gpu.paddle_trt.fp16.txt
+# NVIDIA GPU TRT backend fp32
+./benchmark_gpu_trt.sh config/config.gpu.trt.fp32.txt
+# NVIDIA GPU TRT backend fp16
+./benchmark_gpu_trt.sh config/config.gpu.trt.fp16.txt
+
+# Arm CPU PaddleLite backend fp32
+./benchmark_arm.sh config/config.arm.lite.fp32.txt
+# Arm CPU PaddleLite backend fp32
+./benchmark_arm.sh config/config.arm.lite.fp16.txt
+# XPU Paddle Lite backend fp32
+./benchmark_xpu.sh config/config.xpu.lite.fp32.txt
 ```
-
-