heliqi
42f1888bb0
[Serving][Backend] Backend support zero_copy_infer and Serving reduce the output memory copy ( #703 )
...
* backend add zero copy infer interface
* fix bug
* fix bug
* fix bug
* paddle ipu
2022-11-28 14:07:53 +08:00
yeliang2258
7206094ddd
[Backend] Add ORT CPU and CUDA kernel for adaptive_pool OP ( #609 )
...
* add ORT CPU and CUDA kernel for adaptive_pool
* update code
* update paddle2onnx version
2022-11-24 10:39:29 +08:00
yeliang2258
8d31fe59e8
[Backend] Support the deployment of models which is larger than 2G in ORT and TRT backend ( #514 )
...
* support model bigger than 2G
* update code
* update code
* fix bug
* update code
2022-11-09 11:14:15 +08:00
Jason
9fa612c24b
[Backend] Enable TensorRT BatchedNMSDynamic_TRT plugin ( #449 )
...
* Enable TensorRT EfficientNMS plugin
* remove some temporary code
* Update trt_backend.cc
* Update utils.h
2022-11-04 11:46:29 +08:00
heliqi
b064ddf7ed
[Serving][backend]serving support multi stream and backend support external stream ( #431 )
...
* serving support multi stream
* pybind add external stream
Co-authored-by: Jason <jiangjiajun@baidu.com >
2022-10-26 14:46:13 +08:00
zhoushunjie
ec8b183d9c
remote HOSTDEVICE modifier
2022-10-02 04:28:30 +00:00
heliqi
0805ead0ed
add 'GetOutputInfos' and 'GetInputInfos' interface ( #232 )
...
add GetOutputInfos GetInputInfos
2022-09-15 13:09:31 +08:00
Jason
68523be411
Modify file structure to separate python and cpp code ( #223 )
...
Modify code structure
2022-09-14 15:44:13 +08:00
Jason
ffbc5cc42d
Move cpp code to directory csrcs ( #42 )
...
* move cpp code to csrcs
* move cpp code to csrcs
2022-07-26 17:59:02 +08:00
Jason
17e4dc6b5e
Support remove multiclass_nms to enable ppyoloe to tensorrt ( #40 )
...
* Add custom operator for onnxruntime ans fix paddle backend
* Polish cmake files and runtime apis
* Remove copy libraries
* fix some issue
* fix bug
* fix bug
* Support remove multiclass_nms to enable paddledetection run tensorrt
* Support remove multiclass_nms to enable paddledetection run tensorrt
* Support remove multiclass_nms to enable paddledetection run tensorrt
* Support remove multiclass_nms to enable paddledetection run tensorrt
* add common operator multiclassnms
* fix compile problem
Co-authored-by: root <root@bjyz-sys-gpu-kongming3.bjyz.baidu.com >
2022-07-26 11:16:01 +08:00
Jason
279c993483
Polish cmake files and runtime apis ( #36 )
...
* Add custom operator for onnxruntime ans fix paddle backend
* Polish cmake files and runtime apis
* Remove copy libraries
* fix some issue
* fix bug
* fix bug
2022-07-25 08:59:53 +08:00
Jason
4b681581b1
Add custom operator for onnxruntime and fix paddle backend ( #35 )
...
Add custom operator for onnxruntime ans fix paddle backend
2022-07-23 22:21:36 +08:00
jiangjiajun
9d87046d78
first commit
2022-07-05 09:30:15 +00:00
