heliqi b064ddf7ed [Serving][backend]serving support multi stream and backend support external stream (#431) ...

* serving support multi stream

* pybind add external stream

Co-authored-by: Jason <jiangjiajun@baidu.com>

2022-10-26 14:46:13 +08:00

..

trt_backend.cc

[Serving][backend]serving support multi stream and backend support external stream (#431)

2022-10-26 14:46:13 +08:00

trt_backend.h

[Serving][backend]serving support multi stream and backend support external stream (#431)

2022-10-26 14:46:13 +08:00

utils.cc

Add trt max workspace setting (#308)

2022-09-30 09:54:34 +08:00

utils.h

[Backend] TRT backend & PP-Infer backend support pinned memory (#403)

2022-10-21 18:51:36 +08:00