WJJ1995
d259952224
[Bug Fix] change reused_input_tensors&&reused_output_tensors name ( #534 )
...
* add paddle_trt in benchmark
* update benchmark in device
* update benchmark
* update result doc
* fixed for CI
* update python api_docs
* update index.rst
* add runtime cpp examples
* deal with comments
* Update infer_paddle_tensorrt.py
* Add runtime quick start
* deal with comments
* fixed reused_input_tensors&&reused_output_tensors
Co-authored-by: Jason <928090362@qq.com >
2022-11-09 00:33:33 +08:00
Wang Xinyu
e5c955dd3e
[Model] yolo use external stream, avoid reallocating output tensors ( #447 )
...
* yolov5 use external stream
* yolov5lite/v6/v7/v7e2etrt: optimize output tensor and cuda stream
* avoid reallocating output tensors
* add input output tensors to FastDeployModel
* add cuda.cmake
* rename to reused_input/output_tensors
* eliminate cmake cuda arch error
* use swap to release input and output tensors
Co-authored-by: Jason <jiangjiajun@baidu.com >
2022-11-02 09:52:27 +08:00
Jason
ecbd78ae58
Remove debug code ( #266 )
...
* Rename Frontend to ModelFormat in documents
* Remove useless debug flag
2022-09-22 15:18:50 +08:00
Jason
e227c5625e
Rename fastdeploy_runtime.h to runtime.h and Frontend to ModelFormat ( #263 )
...
rename frontend to model_format
2022-09-22 13:24:05 +08:00
WJJ1995
06908b8beb
Add Benchmark test ( #200 )
...
* add ppcls benchmark
* add ppcls benchmark
* add ppcls benchmark
* add ppcls benchmark
* fixed txt path
* resolve conflict
* resolve conflict
* deal with comments
* Add enable_trt_fp16 option
* Add OV backend for seg and det
* fixed valid backends in ppdet
* fixed valid backends in yolo
* add copyright and rm Chinese Notes
* add ppdet&ppseg&yolo benchmark
* add cpu/gpu mem info
Co-authored-by: Jason <jiangjiajun@baidu.com >
2022-09-14 20:15:01 +08:00
Jason
68523be411
Modify file structure to separate python and cpp code ( #223 )
...
Modify code structure
2022-09-14 15:44:13 +08:00
