Commit Graph

1 Commits

Author SHA1 Message Date
Wang Xinyu
e5c955dd3e [Model] yolo use external stream, avoid reallocating output tensors (#447)
* yolov5 use external stream

* yolov5lite/v6/v7/v7e2etrt: optimize output tensor and cuda stream

* avoid reallocating output tensors

* add input output tensors to FastDeployModel

* add cuda.cmake

* rename to reused_input/output_tensors

* eliminate cmake cuda arch error

* use swap to release input and output tensors

Co-authored-by: Jason <jiangjiajun@baidu.com>
2022-11-02 09:52:27 +08:00