DefTruth
49c033a828
[XPU] Support XPU via Paddle Inference backend ( #1987 )
...
* [backend] Support XPU via Paddle Inference backend
* [backend] Support XPU via Paddle Inference backend
* [backend] Support XPU via Paddle Inference backend
* [XPU] support XPU benchmark via paddle inference
* [XPU] support XPU benchmark via paddle inference
* [benchmark] add xpu paddle h2d config files
2023-05-25 14:13:40 +08:00
DefTruth
a40d6ee093
[benchmark] Update config.xpu.lite.fp32.l3.e2e.mem.txt
2023-04-07 10:41:36 +08:00
WJJ1995
82ce988573
[Benchmark]Fixed benchmark config default device id ( #1749 )
...
* add GPL lisence
* add GPL-3.0 lisence
* add GPL-3.0 lisence
* add GPL-3.0 lisence
* support yolov8
* add pybind for yolov8
* add yolov8 readme
* add cpp benchmark
* add cpu and gpu mem
* public part split
* add runtime mode
* fixed bugs
* add cpu_thread_nums
* deal with comments
* deal with comments
* deal with comments
* rm useless code
* add FASTDEPLOY_DECL
* add FASTDEPLOY_DECL
* fixed for windows
* mv rss to pss
* mv rss to pss
* Update utils.cc
* use thread to collect mem
* Add ResourceUsageMonitor
* rm useless code
* fixed bug
* fixed typo
* update ResourceUsageMonitor
* fixed bug
* fixed bug
* add note for ResourceUsageMonitor
* deal with comments
* add macros
* deal with comments
* deal with comments
* deal with comments
* re-lint
* rm pmap and use mem api
* rm pmap and use mem api
* add mem api
* Add PrintBenchmarkInfo func
* Add PrintBenchmarkInfo func
* Add PrintBenchmarkInfo func
* deal with comments
* fixed enable_paddle_to_trt
* add log for paddle_trt
* support ppcls benchmark
* use new trt option api
* update benchmark info
* simplify benchmark.cc
* simplify benchmark.cc
* deal with comments
* Add ppseg && ppocr benchmark
* add OCR rec img
* add ocr benchmark
* fixed trt shape
* add trt shape
* resolve conflict
* add ENABLE_BENCHMARK define
* Add ClassifyDiff
* Add Resize for ClassifyResult
* deal with comments
* add convert info script
* resolve conflict
* Add SaveBenchmarkResult func
* fixed bug
* fixed bug
* fixed bug
* add config.txt for option
* fixed bug
* fixed bug
* fixed bug
* add benchmark.sh
* mv thread_nums from 8 to 1
* deal with comments
* deal with comments
* fixed readme
* deal with comments
* add all platform shell
* Update config.arm.txt
* Update config.gpu.txt
* Update config.x86.txt
* fixed printinfo bug
* rm proxy
* add more model support
* all backend config.txt
* deal with comments
* Add MattingDiff compare
* fixed predict bug
* adjust warmup/repeat times
* add e2e/mem configs
* fixed typo
* open collect_mem
* fixed typo
* add trt cache option
* fixed bug
* fixed repeat times
* test for benchmark
* test for det benchmark
* for benchmark
* fixed for x86
* add h2d and d2h config
* renmae txt file
* add dynamic shape for pp_trt
* fixed typo
* Update option.h
* add collect shape
* add default value for SetShape()
* add test
* test
* fixed benchmark config
---------
Co-authored-by: DefTruth <31974251+DefTruth@users.noreply.github.com >
2023-03-30 21:20:56 +08:00
DefTruth
3ed3e303aa
Update config.gpu.trt.fp32.txt
2023-03-28 11:55:51 +08:00
DefTruth
dda23bce95
Update config.gpu.trt.fp32.h2d.txt
2023-03-28 11:55:34 +08:00
DefTruth
fe7c40f1ff
Update config.gpu.trt.fp32.e2e.txt
2023-03-28 11:55:11 +08:00
DefTruth
7be66c811e
Update config.gpu.trt.fp32.e2e.mem.txt
2023-03-28 11:54:47 +08:00
DefTruth
57b5c598a7
Update config.gpu.trt.fp16.txt
2023-03-28 11:54:22 +08:00
DefTruth
7936833451
Update config.gpu.trt.fp16.h2d.txt
2023-03-28 11:54:00 +08:00
DefTruth
76936391e3
Update config.gpu.trt.fp16.e2e.txt
2023-03-28 11:53:29 +08:00
DefTruth
5f273b2541
Update config.gpu.trt.fp16.e2e.mem.txt
2023-03-28 11:53:08 +08:00
WJJ1995
f0235a4c4e
[Benchmark]Add inlcude_h2d_d2h config for trt ( #1699 )
...
* add GPL lisence
* add GPL-3.0 lisence
* add GPL-3.0 lisence
* add GPL-3.0 lisence
* support yolov8
* add pybind for yolov8
* add yolov8 readme
* add cpp benchmark
* add cpu and gpu mem
* public part split
* add runtime mode
* fixed bugs
* add cpu_thread_nums
* deal with comments
* deal with comments
* deal with comments
* rm useless code
* add FASTDEPLOY_DECL
* add FASTDEPLOY_DECL
* fixed for windows
* mv rss to pss
* mv rss to pss
* Update utils.cc
* use thread to collect mem
* Add ResourceUsageMonitor
* rm useless code
* fixed bug
* fixed typo
* update ResourceUsageMonitor
* fixed bug
* fixed bug
* add note for ResourceUsageMonitor
* deal with comments
* add macros
* deal with comments
* deal with comments
* deal with comments
* re-lint
* rm pmap and use mem api
* rm pmap and use mem api
* add mem api
* Add PrintBenchmarkInfo func
* Add PrintBenchmarkInfo func
* Add PrintBenchmarkInfo func
* deal with comments
* fixed enable_paddle_to_trt
* add log for paddle_trt
* support ppcls benchmark
* use new trt option api
* update benchmark info
* simplify benchmark.cc
* simplify benchmark.cc
* deal with comments
* Add ppseg && ppocr benchmark
* add OCR rec img
* add ocr benchmark
* fixed trt shape
* add trt shape
* resolve conflict
* add ENABLE_BENCHMARK define
* Add ClassifyDiff
* Add Resize for ClassifyResult
* deal with comments
* add convert info script
* resolve conflict
* Add SaveBenchmarkResult func
* fixed bug
* fixed bug
* fixed bug
* add config.txt for option
* fixed bug
* fixed bug
* fixed bug
* add benchmark.sh
* mv thread_nums from 8 to 1
* deal with comments
* deal with comments
* fixed readme
* deal with comments
* add all platform shell
* Update config.arm.txt
* Update config.gpu.txt
* Update config.x86.txt
* fixed printinfo bug
* rm proxy
* add more model support
* all backend config.txt
* deal with comments
* Add MattingDiff compare
* fixed predict bug
* adjust warmup/repeat times
* add e2e/mem configs
* fixed typo
* open collect_mem
* fixed typo
* add trt cache option
* fixed bug
* fixed repeat times
* test for benchmark
* test for det benchmark
* for benchmark
* fixed for x86
* add h2d and d2h config
* renmae txt file
---------
Co-authored-by: DefTruth <31974251+DefTruth@users.noreply.github.com >
2023-03-24 11:17:49 +08:00
DefTruth
ab65557121
[Benchmark] fix ppdet models download urls ( #1679 )
...
* [Benchmark] fix ppdet download urls
* [Benchmark] fix ppdet download urls
* [Benchmark] fix ppdet download urls
* [Benchmark] fix ppdet download urls
2023-03-22 18:06:00 +08:00
WJJ1995
19d3b188f8
[Benchmark]Mv thread_nums from 1 to 8 in x86 ( #1670 )
...
* avoid mem copy for cpp benchmark
* set CMAKE_BUILD_TYPE to Release
* Add SegmentationDiff
* change pointer to reference
* fixed bug
* cast uint8 to int32
* Add diff compare for OCR
* Add diff compare for OCR
* rm ppocr pipeline
* Add yolov5 diff compare
* Add yolov5 diff compare
* deal with comments
* deal with comments
* fixed bug
* fixed bug
* fixed thread nums
2023-03-21 21:34:04 +08:00
WJJ1995
d522ef28b4
[Benchmark]Add trt cache option ( #1653 )
...
* add GPL lisence
* add GPL-3.0 lisence
* add GPL-3.0 lisence
* add GPL-3.0 lisence
* support yolov8
* add pybind for yolov8
* add yolov8 readme
* add cpp benchmark
* add cpu and gpu mem
* public part split
* add runtime mode
* fixed bugs
* add cpu_thread_nums
* deal with comments
* deal with comments
* deal with comments
* rm useless code
* add FASTDEPLOY_DECL
* add FASTDEPLOY_DECL
* fixed for windows
* mv rss to pss
* mv rss to pss
* Update utils.cc
* use thread to collect mem
* Add ResourceUsageMonitor
* rm useless code
* fixed bug
* fixed typo
* update ResourceUsageMonitor
* fixed bug
* fixed bug
* add note for ResourceUsageMonitor
* deal with comments
* add macros
* deal with comments
* deal with comments
* deal with comments
* re-lint
* rm pmap and use mem api
* rm pmap and use mem api
* add mem api
* Add PrintBenchmarkInfo func
* Add PrintBenchmarkInfo func
* Add PrintBenchmarkInfo func
* deal with comments
* fixed enable_paddle_to_trt
* add log for paddle_trt
* support ppcls benchmark
* use new trt option api
* update benchmark info
* simplify benchmark.cc
* simplify benchmark.cc
* deal with comments
* Add ppseg && ppocr benchmark
* add OCR rec img
* add ocr benchmark
* fixed trt shape
* add trt shape
* resolve conflict
* add ENABLE_BENCHMARK define
* Add ClassifyDiff
* Add Resize for ClassifyResult
* deal with comments
* add convert info script
* resolve conflict
* Add SaveBenchmarkResult func
* fixed bug
* fixed bug
* fixed bug
* add config.txt for option
* fixed bug
* fixed bug
* fixed bug
* add benchmark.sh
* mv thread_nums from 8 to 1
* deal with comments
* deal with comments
* fixed readme
* deal with comments
* add all platform shell
* Update config.arm.txt
* Update config.gpu.txt
* Update config.x86.txt
* fixed printinfo bug
* rm proxy
* add more model support
* all backend config.txt
* deal with comments
* Add MattingDiff compare
* fixed predict bug
* adjust warmup/repeat times
* add e2e/mem configs
* fixed typo
* open collect_mem
* fixed typo
* add trt cache option
* fixed bug
* fixed repeat times
---------
Co-authored-by: DefTruth <31974251+DefTruth@users.noreply.github.com >
2023-03-20 18:08:28 +08:00
WJJ1995
5687cdfbea
[Benchmark] Open collect_info in config ( #1649 )
...
* add GPL lisence
* add GPL-3.0 lisence
* add GPL-3.0 lisence
* add GPL-3.0 lisence
* support yolov8
* add pybind for yolov8
* add yolov8 readme
* add cpp benchmark
* add cpu and gpu mem
* public part split
* add runtime mode
* fixed bugs
* add cpu_thread_nums
* deal with comments
* deal with comments
* deal with comments
* rm useless code
* add FASTDEPLOY_DECL
* add FASTDEPLOY_DECL
* fixed for windows
* mv rss to pss
* mv rss to pss
* Update utils.cc
* use thread to collect mem
* Add ResourceUsageMonitor
* rm useless code
* fixed bug
* fixed typo
* update ResourceUsageMonitor
* fixed bug
* fixed bug
* add note for ResourceUsageMonitor
* deal with comments
* add macros
* deal with comments
* deal with comments
* deal with comments
* re-lint
* rm pmap and use mem api
* rm pmap and use mem api
* add mem api
* Add PrintBenchmarkInfo func
* Add PrintBenchmarkInfo func
* Add PrintBenchmarkInfo func
* deal with comments
* fixed enable_paddle_to_trt
* add log for paddle_trt
* support ppcls benchmark
* use new trt option api
* update benchmark info
* simplify benchmark.cc
* simplify benchmark.cc
* deal with comments
* Add ppseg && ppocr benchmark
* add OCR rec img
* add ocr benchmark
* fixed trt shape
* add trt shape
* resolve conflict
* add ENABLE_BENCHMARK define
* Add ClassifyDiff
* Add Resize for ClassifyResult
* deal with comments
* add convert info script
* resolve conflict
* Add SaveBenchmarkResult func
* fixed bug
* fixed bug
* fixed bug
* add config.txt for option
* fixed bug
* fixed bug
* fixed bug
* add benchmark.sh
* mv thread_nums from 8 to 1
* deal with comments
* deal with comments
* fixed readme
* deal with comments
* add all platform shell
* Update config.arm.txt
* Update config.gpu.txt
* Update config.x86.txt
* fixed printinfo bug
* rm proxy
* add more model support
* all backend config.txt
* deal with comments
* Add MattingDiff compare
* fixed predict bug
* adjust warmup/repeat times
* add e2e/mem configs
* fixed typo
* open collect_mem
---------
Co-authored-by: DefTruth <31974251+DefTruth@users.noreply.github.com >
2023-03-18 11:32:40 +08:00
DefTruth
6af3691568
[XPU] Update Lite XPU lib and fixed some bugs ( #1647 )
2023-03-17 21:39:39 +08:00
WJJ1995
1b37cb0c03
[Benchmark]Add End2End and meminfo configs ( #1645 )
...
* add GPL lisence
* add GPL-3.0 lisence
* add GPL-3.0 lisence
* add GPL-3.0 lisence
* support yolov8
* add pybind for yolov8
* add yolov8 readme
* add cpp benchmark
* add cpu and gpu mem
* public part split
* add runtime mode
* fixed bugs
* add cpu_thread_nums
* deal with comments
* deal with comments
* deal with comments
* rm useless code
* add FASTDEPLOY_DECL
* add FASTDEPLOY_DECL
* fixed for windows
* mv rss to pss
* mv rss to pss
* Update utils.cc
* use thread to collect mem
* Add ResourceUsageMonitor
* rm useless code
* fixed bug
* fixed typo
* update ResourceUsageMonitor
* fixed bug
* fixed bug
* add note for ResourceUsageMonitor
* deal with comments
* add macros
* deal with comments
* deal with comments
* deal with comments
* re-lint
* rm pmap and use mem api
* rm pmap and use mem api
* add mem api
* Add PrintBenchmarkInfo func
* Add PrintBenchmarkInfo func
* Add PrintBenchmarkInfo func
* deal with comments
* fixed enable_paddle_to_trt
* add log for paddle_trt
* support ppcls benchmark
* use new trt option api
* update benchmark info
* simplify benchmark.cc
* simplify benchmark.cc
* deal with comments
* Add ppseg && ppocr benchmark
* add OCR rec img
* add ocr benchmark
* fixed trt shape
* add trt shape
* resolve conflict
* add ENABLE_BENCHMARK define
* Add ClassifyDiff
* Add Resize for ClassifyResult
* deal with comments
* add convert info script
* resolve conflict
* Add SaveBenchmarkResult func
* fixed bug
* fixed bug
* fixed bug
* add config.txt for option
* fixed bug
* fixed bug
* fixed bug
* add benchmark.sh
* mv thread_nums from 8 to 1
* deal with comments
* deal with comments
* fixed readme
* deal with comments
* add all platform shell
* Update config.arm.txt
* Update config.gpu.txt
* Update config.x86.txt
* fixed printinfo bug
* rm proxy
* add more model support
* all backend config.txt
* deal with comments
* Add MattingDiff compare
* fixed predict bug
* adjust warmup/repeat times
* add e2e/mem configs
* fixed typo
---------
Co-authored-by: DefTruth <31974251+DefTruth@users.noreply.github.com >
2023-03-17 17:30:47 +08:00
WJJ1995
281d6140ce
[Benchmark]Adjust warmup/repeat times ( #1632 )
...
* add GPL lisence
* add GPL-3.0 lisence
* add GPL-3.0 lisence
* add GPL-3.0 lisence
* support yolov8
* add pybind for yolov8
* add yolov8 readme
* add cpp benchmark
* add cpu and gpu mem
* public part split
* add runtime mode
* fixed bugs
* add cpu_thread_nums
* deal with comments
* deal with comments
* deal with comments
* rm useless code
* add FASTDEPLOY_DECL
* add FASTDEPLOY_DECL
* fixed for windows
* mv rss to pss
* mv rss to pss
* Update utils.cc
* use thread to collect mem
* Add ResourceUsageMonitor
* rm useless code
* fixed bug
* fixed typo
* update ResourceUsageMonitor
* fixed bug
* fixed bug
* add note for ResourceUsageMonitor
* deal with comments
* add macros
* deal with comments
* deal with comments
* deal with comments
* re-lint
* rm pmap and use mem api
* rm pmap and use mem api
* add mem api
* Add PrintBenchmarkInfo func
* Add PrintBenchmarkInfo func
* Add PrintBenchmarkInfo func
* deal with comments
* fixed enable_paddle_to_trt
* add log for paddle_trt
* support ppcls benchmark
* use new trt option api
* update benchmark info
* simplify benchmark.cc
* simplify benchmark.cc
* deal with comments
* Add ppseg && ppocr benchmark
* add OCR rec img
* add ocr benchmark
* fixed trt shape
* add trt shape
* resolve conflict
* add ENABLE_BENCHMARK define
* Add ClassifyDiff
* Add Resize for ClassifyResult
* deal with comments
* add convert info script
* resolve conflict
* Add SaveBenchmarkResult func
* fixed bug
* fixed bug
* fixed bug
* add config.txt for option
* fixed bug
* fixed bug
* fixed bug
* add benchmark.sh
* mv thread_nums from 8 to 1
* deal with comments
* deal with comments
* fixed readme
* deal with comments
* add all platform shell
* Update config.arm.txt
* Update config.gpu.txt
* Update config.x86.txt
* fixed printinfo bug
* rm proxy
* add more model support
* all backend config.txt
* deal with comments
* Add MattingDiff compare
* fixed predict bug
* adjust warmup/repeat times
---------
Co-authored-by: DefTruth <31974251+DefTruth@users.noreply.github.com >
2023-03-16 13:08:16 +08:00
WJJ1995
11dd2512c5
[Benchmark] Add all backend config ( #1587 )
...
* add GPL lisence
* add GPL-3.0 lisence
* add GPL-3.0 lisence
* add GPL-3.0 lisence
* support yolov8
* add pybind for yolov8
* add yolov8 readme
* add cpp benchmark
* add cpu and gpu mem
* public part split
* add runtime mode
* fixed bugs
* add cpu_thread_nums
* deal with comments
* deal with comments
* deal with comments
* rm useless code
* add FASTDEPLOY_DECL
* add FASTDEPLOY_DECL
* fixed for windows
* mv rss to pss
* mv rss to pss
* Update utils.cc
* use thread to collect mem
* Add ResourceUsageMonitor
* rm useless code
* fixed bug
* fixed typo
* update ResourceUsageMonitor
* fixed bug
* fixed bug
* add note for ResourceUsageMonitor
* deal with comments
* add macros
* deal with comments
* deal with comments
* deal with comments
* re-lint
* rm pmap and use mem api
* rm pmap and use mem api
* add mem api
* Add PrintBenchmarkInfo func
* Add PrintBenchmarkInfo func
* Add PrintBenchmarkInfo func
* deal with comments
* fixed enable_paddle_to_trt
* add log for paddle_trt
* support ppcls benchmark
* use new trt option api
* update benchmark info
* simplify benchmark.cc
* simplify benchmark.cc
* deal with comments
* Add ppseg && ppocr benchmark
* add OCR rec img
* add ocr benchmark
* fixed trt shape
* add trt shape
* resolve conflict
* add ENABLE_BENCHMARK define
* Add ClassifyDiff
* Add Resize for ClassifyResult
* deal with comments
* add convert info script
* resolve conflict
* Add SaveBenchmarkResult func
* fixed bug
* fixed bug
* fixed bug
* add config.txt for option
* fixed bug
* fixed bug
* fixed bug
* add benchmark.sh
* mv thread_nums from 8 to 1
* deal with comments
* deal with comments
* fixed readme
* deal with comments
* add all platform shell
* Update config.arm.txt
* Update config.gpu.txt
* Update config.x86.txt
* fixed printinfo bug
* rm proxy
* add more model support
* all backend config.txt
* deal with comments
---------
Co-authored-by: DefTruth <31974251+DefTruth@users.noreply.github.com >
2023-03-13 15:36:30 +08:00
