heliqi 42f1888bb0 [Serving][Backend] Backend support zero_copy_infer and Serving reduce the output memory copy (#703) ...

* backend add zero copy infer interface

* fix bug

* fix bug

* fix bug

* paddle ipu

2022-11-28 14:07:53 +08:00

..

common

Modify file structure to separate python and cpp code (#223)

2022-09-14 15:44:13 +08:00

lite

[Serving][Backend] Backend support zero_copy_infer and Serving reduce the output memory copy (#703)

2022-11-28 14:07:53 +08:00

op_cuda_kernels

[Backend] Add AdaptivePool2d for TensorRT plugin (#668)

2022-11-25 17:36:59 +08:00

openvino

[Serving][Backend] Backend support zero_copy_infer and Serving reduce the output memory copy (#703)

2022-11-28 14:07:53 +08:00

ort

[Serving][Backend] Backend support zero_copy_infer and Serving reduce the output memory copy (#703)

2022-11-28 14:07:53 +08:00

paddle

[Serving][Backend] Backend support zero_copy_infer and Serving reduce the output memory copy (#703)

2022-11-28 14:07:53 +08:00

poros

[Serving][Backend] Backend support zero_copy_infer and Serving reduce the output memory copy (#703)

2022-11-28 14:07:53 +08:00

rknpu/rknpu2

[Serving][Backend] Backend support zero_copy_infer and Serving reduce the output memory copy (#703)

2022-11-28 14:07:53 +08:00

tensorrt

[Serving][Backend] Backend support zero_copy_infer and Serving reduce the output memory copy (#703)

2022-11-28 14:07:53 +08:00

backend.h

[Serving][Backend] Backend support zero_copy_infer and Serving reduce the output memory copy (#703)

2022-11-28 14:07:53 +08:00