heliqi
42f1888bb0
[Serving][Backend] Backend support zero_copy_infer and Serving reduce the output memory copy ( #703 )
...
* backend add zero copy infer interface
* fix bug
* fix bug
* fix bug
* paddle ipu
2022-11-28 14:07:53 +08:00
Jason
5b3fd9dd88
[Backend] Support Intel GPU with heterogeneous mode ( #701 )
...
* Add some comments for python api
* support openvino gpu
* Add cpu operators
* add interface to specify hetero operators
* remove useless dir
* format code
* remove debug code
* Support GPU for ONNX
2022-11-25 19:40:56 +08:00
Jason
dbe96cd049
[Backend] Support Intel GPU with OpenVINO ( #472 )
...
* Update ov_backend.cc
* Update ov_backend.cc
* support set openvino device
2022-11-17 17:08:49 +08:00
heliqi
277bec38c7
[Backend & Serving] Serving and Runtime support Clone ( #464 )
...
* Add Serving and Runtime use Clone
* support TRT, OpenVINO and Paddle Backend
Co-authored-by: Jason <jiangjiajun@baidu.com >
2022-11-04 17:16:40 +08:00
zhoushunjie
ec8b183d9c
remote HOSTDEVICE modifier
2022-10-02 04:28:30 +00:00
Jason
5046574b95
Fix bug for part of detection model ( #243 )
...
* fix error for part of detection model
* fix error for part of detection model
* add patch paddle inference
2022-09-16 16:31:34 +08:00
heliqi
0805ead0ed
add 'GetOutputInfos' and 'GetInputInfos' interface ( #232 )
...
add GetOutputInfos GetInputInfos
2022-09-15 13:09:31 +08:00
Jason
68523be411
Modify file structure to separate python and cpp code ( #223 )
...
Modify code structure
2022-09-14 15:44:13 +08:00
