WJJ1995
ea0bac4061
[Benchmark] Add GPU OpenVIVO Option in benchmark ( #786 )
...
* add paddle_trt in benchmark
* update benchmark in device
* update benchmark
* update result doc
* fixed for CI
* update python api_docs
* update index.rst
* add runtime cpp examples
* deal with comments
* Update infer_paddle_tensorrt.py
* Add runtime quick start
* deal with comments
* fixed reused_input_tensors&&reused_output_tensors
* fixed docs
* fixed headpose typo
* fixed typo
* refactor yolov5
* update model infer
* refactor pybind for yolov5
* rm origin yolov5
* fixed bugs
* rm cuda preprocess
* fixed bugs
* fixed bugs
* fixed bug
* fixed bug
* fix pybind
* rm useless code
* add convert_and_permute
* fixed bugs
* fixed im_info for bs_predict
* fixed bug
* add bs_predict for yolov5
* Add runtime test and batch eval
* deal with comments
* fixed bug
* update testcase
* fixed batch eval bug
* fixed preprocess bug
* refactor yolov7
* add yolov7 testcase
* rm resize_after_load and add is_scale_up
* fixed bug
* set multi_label true
* optimize rvm preprocess
* optimizer rvm postprocess
* fixed bug
* deal with comments
* fixed bugs
* add gpu ov for benchmark
Co-authored-by: Jason <928090362@qq.com >
Co-authored-by: Jason <jiangjiajun@baidu.com >
2022-12-05 10:51:13 +08:00
heliqi
42f1888bb0
[Serving][Backend] Backend support zero_copy_infer and Serving reduce the output memory copy ( #703 )
...
* backend add zero copy infer interface
* fix bug
* fix bug
* fix bug
* paddle ipu
2022-11-28 14:07:53 +08:00
Jason
5b3fd9dd88
[Backend] Support Intel GPU with heterogeneous mode ( #701 )
...
* Add some comments for python api
* support openvino gpu
* Add cpu operators
* add interface to specify hetero operators
* remove useless dir
* format code
* remove debug code
* Support GPU for ONNX
2022-11-25 19:40:56 +08:00
Jason
dbe96cd049
[Backend] Support Intel GPU with OpenVINO ( #472 )
...
* Update ov_backend.cc
* Update ov_backend.cc
* support set openvino device
2022-11-17 17:08:49 +08:00
heliqi
277bec38c7
[Backend & Serving] Serving and Runtime support Clone ( #464 )
...
* Add Serving and Runtime use Clone
* support TRT, OpenVINO and Paddle Backend
Co-authored-by: Jason <jiangjiajun@baidu.com >
2022-11-04 17:16:40 +08:00
zhoushunjie
ec8b183d9c
remote HOSTDEVICE modifier
2022-10-02 04:28:30 +00:00
Jason
5046574b95
Fix bug for part of detection model ( #243 )
...
* fix error for part of detection model
* fix error for part of detection model
* add patch paddle inference
2022-09-16 16:31:34 +08:00
heliqi
0805ead0ed
add 'GetOutputInfos' and 'GetInputInfos' interface ( #232 )
...
add GetOutputInfos GetInputInfos
2022-09-15 13:09:31 +08:00
Jason
68523be411
Modify file structure to separate python and cpp code ( #223 )
...
Modify code structure
2022-09-14 15:44:13 +08:00
