23 Commits

Author	SHA1	Message	Date
ChaoII	116265d239	add override mark (#312) ... Co-authored-by: Jason <jiangjiajun@baidu.com>	2022-10-07 11:38:31 +08:00
Jason	a8e08c9c1a	Merge branch 'develop' into add_float16_dtype	2022-10-05 10:47:52 +08:00
DefTruth	c4288a92e1	[lite] add more options for lite backend (#313) ... * [cmake] support Android arm64-v8a & armeabi-v7a native c++ sdk * [cmake] fixed patchelf download on mac and android * [lite] Add threads and power_mode option support * [pybind] update runtime pybind for lite power mode * [python] Add set_lite_power_mode api to runtime * [Lite] add lite enable_fp16 option support * [lite] add more options for lite backend. * [cmake] fixed Paddle Lite typo * [runtime] format LitePowerMode enum comments * [runtime] format lite option comments	2022-10-04 17:31:48 +08:00
zhoushunjie	faf04b49a6	Add float16 tests	2022-10-02 09:21:00 +00:00
zhoushunjie	ec8b183d9c	remote HOSTDEVICE modifier	2022-10-02 04:28:30 +00:00
Jason	8a1e2c6143	Add some comments for runtime (#309) ... * Add some notes for runtime * modify note * modify note * add some comment * Add comment for runtime * Add comment for runtime * Add comment for runtime * Add comment for runtime	2022-09-30 14:43:44 +08:00
Jack Zhou	dd365fb721	Add trt max workspace setting (#308) ... * add trt max workspace setting * fix set trt max workspace	2022-09-30 09:54:34 +08:00
DefTruth	c5f85de356	[lite] Add threads and power_mode option support (#298) ... * [cmake] support Android arm64-v8a & armeabi-v7a native c++ sdk * [cmake] fixed patchelf download on mac and android * [lite] Add threads and power_mode option support * [pybind] update runtime pybind for lite power mode * [python] Add set_lite_power_mode api to runtime	2022-09-28 18:09:35 +08:00
Jason	360bee46b5	Support build on jetson (#276) ... * support jetson build * Update allocate.cc * update setup * Update CMakeLists.txt * Update setup.py	2022-09-23 13:11:11 +08:00
DefTruth	5edd9fccd3	[TRT] fix tensorrt serialize file problem (#274) ... fix tensorrt serialize file problem	2022-09-23 00:40:17 +08:00
Jason	addce837bc	Add paddlelite backend support (#260) ... * Add paddlelite backend support * Update CMakeLists.txt * Update __init__.py	2022-09-21 13:22:34 +08:00
Jason	5046574b95	Fix bug for part of detection model (#243) ... * fix error for part of detection model * fix error for part of detection model * add patch paddle inference	2022-09-16 16:31:34 +08:00
heliqi	0805ead0ed	add 'GetOutputInfos' and 'GetInputInfos' interface (#232) ... add GetOutputInfos GetInputInfos	2022-09-15 13:09:31 +08:00
Jason	68523be411	Modify file structure to separate python and cpp code (#223) ... Modify code structure	2022-09-14 15:44:13 +08:00
Jason	ffbc5cc42d	Move cpp code to directory csrcs (#42) ... * move cpp code to csrcs * move cpp code to csrcs	2022-07-26 17:59:02 +08:00
Jason	17e4dc6b5e	Support remove multiclass_nms to enable ppyoloe to tensorrt (#40) ... * Add custom operator for onnxruntime ans fix paddle backend * Polish cmake files and runtime apis * Remove copy libraries * fix some issue * fix bug * fix bug * Support remove multiclass_nms to enable paddledetection run tensorrt * Support remove multiclass_nms to enable paddledetection run tensorrt * Support remove multiclass_nms to enable paddledetection run tensorrt * Support remove multiclass_nms to enable paddledetection run tensorrt * add common operator multiclassnms * fix compile problem Co-authored-by: root <root@bjyz-sys-gpu-kongming3.bjyz.baidu.com>	2022-07-26 11:16:01 +08:00
Jason	279c993483	Polish cmake files and runtime apis (#36) ... * Add custom operator for onnxruntime ans fix paddle backend * Polish cmake files and runtime apis * Remove copy libraries * fix some issue * fix bug * fix bug	2022-07-25 08:59:53 +08:00
Jason	4b681581b1	Add custom operator for onnxruntime and fix paddle backend (#35) ... Add custom operator for onnxruntime ans fix paddle backend	2022-07-23 22:21:36 +08:00
Jason	51ecb407d4	Add Paddle Inference as backend (#33) ... * Add Paddle Inference as backend * Update CMakeLists.txt * Fix default backend option * Fix some log bug and backend choosing strategy * Add version of g++	2022-07-22 09:53:46 +08:00
Jason	90061e11f5	Fix outputs order of tensorrt (#18) ... * fix trt output order * Update trt_backend.cc	2022-07-14 19:19:56 +08:00
DefTruth	a45f189b56	fixed missing trt_backend option & remove un-need data layout check in Cast (#14) ... * update .gitignore * Added checking for cmake include dir * fixed missing trt_backend option bug when init from trt * remove un-need data layout and add pre-check for dtype * changed RGB2BRG to BGR2RGB in ppcls model * Update CMakeLists.txt	2022-07-12 15:14:30 +08:00
Jason	2b742d37e0	fix some bugs (#12)	2022-07-08 19:36:38 +08:00
jiangjiajun	9d87046d78	first commit	2022-07-05 09:30:15 +00:00