Commit Graph

7 Commits

Author SHA1 Message Date
heliqi
4d1f264d01 FDTensor support GPU device (#190)
* fdtensor support GPU

* TRT backend support GPU FDTensor

* FDHostAllocator add FASTDEPLOY_DECL

* fix FDTensor Data

* fix FDTensor dtype

Co-authored-by: Jason <jiangjiajun@baidu.com>
2022-09-08 16:53:08 +08:00
Jason
e09ac18a7d Fix directly visit member of FDTensor (#193)
* optimize tensorrt usage

* format code

* fix input shape error for onnx model

* Remove some code directly visit FDTensor member (#192)

remove some code directly visit FDTensor member

* fix directly visit member of FDTensor

Co-authored-by: root <root@bjyz-sys-gpu-kongming3.bjyz.baidu.com>
2022-09-06 11:12:02 +08:00
Jason
969531dcc8 Optimize TensorRT backend to support rebuild engine (#189)
* optimize tensorrt usage

* format code

* fix input shape error for onnx model

Co-authored-by: root <root@bjyz-sys-gpu-kongming3.bjyz.baidu.com>
2022-09-06 10:53:05 +08:00
Jason
737b62a2ba Remove tensorrt/common codes (#171) 2022-08-29 19:21:18 +08:00
WJJ1995
ac88f640aa Fixed TRT Init bug (#127)
fixed TRT Init bug
2022-08-18 13:02:51 +08:00
jiangjiajun
e623a7b6de Fix FDASSERT in tensorrt backend 2022-08-17 05:57:21 +00:00
jiangjiajun
72eb130193 add csrc code 2022-08-10 02:52:36 +00:00