Commit Graph

4 Commits

Author SHA1 Message Date
Wang Xinyu
e5c955dd3e [Model] yolo use external stream, avoid reallocating output tensors (#447)
* yolov5 use external stream

* yolov5lite/v6/v7/v7e2etrt: optimize output tensor and cuda stream

* avoid reallocating output tensors

* add input output tensors to FastDeployModel

* add cuda.cmake

* rename to reused_input/output_tensors

* eliminate cmake cuda arch error

* use swap to release input and output tensors

Co-authored-by: Jason <jiangjiajun@baidu.com>
2022-11-02 09:52:27 +08:00
DefTruth
efa7411ebb Delete redundant Chinese comments (#275) 2022-09-23 11:02:00 +08:00
Jason
e227c5625e Rename fastdeploy_runtime.h to runtime.h and Frontend to ModelFormat (#263)
rename frontend to model_format
2022-09-22 13:24:05 +08:00
Jason
68523be411 Modify file structure to separate python and cpp code (#223)
Modify code structure
2022-09-14 15:44:13 +08:00