mirror of
https://github.com/PaddlePaddle/FastDeploy.git
synced 2025-10-06 17:17:14 +08:00
[Backend] TRT backend & PP-Infer backend support pinned memory (#403)
* TRT backend use pinned memory * refine fd tensor pinned memory logic * TRT enable pinned memory configurable * paddle inference support pinned memory * pinned memory pybindings Co-authored-by: Jason <jiangjiajun@baidu.com>
This commit is contained in:
@@ -206,6 +206,8 @@ class FDGenericBuffer {
|
||||
};
|
||||
|
||||
using FDDeviceBuffer = FDGenericBuffer<FDDeviceAllocator, FDDeviceFree>;
|
||||
using FDDeviceHostBuffer = FDGenericBuffer<FDDeviceHostAllocator,
|
||||
FDDeviceHostFree>;
|
||||
|
||||
class FDTrtLogger : public nvinfer1::ILogger {
|
||||
public:
|
||||
|
Reference in New Issue
Block a user