Commit Graph

7 Commits

Author SHA1 Message Date
WJJ1995
d3845eb4e1 [Benchmark]Compare diff for OCR (#1415)
* avoid mem copy for cpp benchmark

* set CMAKE_BUILD_TYPE to Release

* Add SegmentationDiff

* change pointer to reference

* fixed bug

* cast uint8 to int32

* Add diff compare for OCR

* Add diff compare for OCR

* rm ppocr pipeline

* Add yolov5 diff compare

* Add yolov5 diff compare

* deal with comments

* deal with comments

* fixed bug

* fixed bug
2023-02-23 18:57:39 +08:00
WJJ1995
d259952224 [Bug Fix] change reused_input_tensors&&reused_output_tensors name (#534)
* add paddle_trt in benchmark

* update benchmark in device

* update benchmark

* update result doc

* fixed for CI

* update python api_docs

* update index.rst

* add runtime cpp examples

* deal with comments

* Update infer_paddle_tensorrt.py

* Add runtime quick start

* deal with comments

* fixed reused_input_tensors&&reused_output_tensors

Co-authored-by: Jason <928090362@qq.com>
2022-11-09 00:33:33 +08:00
Wang Xinyu
e5c955dd3e [Model] yolo use external stream, avoid reallocating output tensors (#447)
* yolov5 use external stream

* yolov5lite/v6/v7/v7e2etrt: optimize output tensor and cuda stream

* avoid reallocating output tensors

* add input output tensors to FastDeployModel

* add cuda.cmake

* rename to reused_input/output_tensors

* eliminate cmake cuda arch error

* use swap to release input and output tensors

Co-authored-by: Jason <jiangjiajun@baidu.com>
2022-11-02 09:52:27 +08:00
Jason
ecbd78ae58 Remove debug code (#266)
* Rename Frontend to ModelFormat in documents

* Remove useless debug flag
2022-09-22 15:18:50 +08:00
Jason
e227c5625e Rename fastdeploy_runtime.h to runtime.h and Frontend to ModelFormat (#263)
rename frontend to model_format
2022-09-22 13:24:05 +08:00
WJJ1995
06908b8beb Add Benchmark test (#200)
* add ppcls benchmark

* add ppcls benchmark

* add ppcls benchmark

* add ppcls benchmark

* fixed txt path

* resolve conflict

* resolve conflict

* deal with comments

* Add enable_trt_fp16 option

* Add OV backend for seg and det

* fixed valid backends in ppdet

* fixed valid backends in yolo

* add copyright and rm Chinese Notes

* add ppdet&ppseg&yolo benchmark

* add cpu/gpu mem info

Co-authored-by: Jason <jiangjiajun@baidu.com>
2022-09-14 20:15:01 +08:00
Jason
68523be411 Modify file structure to separate python and cpp code (#223)
Modify code structure
2022-09-14 15:44:13 +08:00