22 Commits

Author	SHA1	Message	Date
Jason	945e197bd1	Fix bug of get input/output information from PaddleBackend (#339) ... * Fix bug of get input/output information from PaddleBackend * Support Paddle Inference with TensorRT (#340) * Fix bug	2022-10-12 11:37:26 +08:00
yeliang2258	2a68a23baf	Add paddle quantize model support for ORT, TRT and MKLDNN deploy backend (#257) ... * add quantize model support for trt and paddle * fix bugs * fix * update paddle2onnx version * update version * add quantize test Co-authored-by: Jason <jiangjiajun@baidu.com>	2022-10-09 20:00:05 +08:00
heliqi	d57e997fa0	Fd serving add docker images correlation and docs (#311) ... * fd serving add dockerfile * fix enable_paddle_mkldnn * delete disable_paddle_mkldnn Co-authored-by: Jason <jiangjiajun@baidu.com>	2022-10-08 16:08:07 +08:00
Jason	a8e08c9c1a	Merge branch 'develop' into add_float16_dtype	2022-10-05 10:47:52 +08:00
zhoushunjie	6e4319348b	add float16	2022-10-05 02:44:39 +00:00
DefTruth	c4288a92e1	[lite] add more options for lite backend (#313) ... * [cmake] support Android arm64-v8a & armeabi-v7a native c++ sdk * [cmake] fixed patchelf download on mac and android * [lite] Add threads and power_mode option support * [pybind] update runtime pybind for lite power mode * [python] Add set_lite_power_mode api to runtime * [Lite] add lite enable_fp16 option support * [lite] add more options for lite backend. * [cmake] fixed Paddle Lite typo * [runtime] format LitePowerMode enum comments * [runtime] format lite option comments	2022-10-04 17:31:48 +08:00
zhoushunjie	ec8b183d9c	remote HOSTDEVICE modifier	2022-10-02 04:28:30 +00:00
Jack Zhou	dd365fb721	Add trt max workspace setting (#308) ... * add trt max workspace setting * fix set trt max workspace	2022-09-30 09:54:34 +08:00
DefTruth	c5f85de356	[lite] Add threads and power_mode option support (#298) ... * [cmake] support Android arm64-v8a & armeabi-v7a native c++ sdk * [cmake] fixed patchelf download on mac and android * [lite] Add threads and power_mode option support * [pybind] update runtime pybind for lite power mode * [python] Add set_lite_power_mode api to runtime	2022-09-28 18:09:35 +08:00
Jason	2d3e61582d	Rename pybind/fastdeploy_runtime.cc to pybind/runtime.cc (#273) ... * fix yaml * Rename pybind/fastdeploy_runtime.cc to runtime.cc	2022-09-23 11:16:02 +08:00
Jason	e227c5625e	Rename fastdeploy_runtime.h to runtime.h and Frontend to ModelFormat (#263) ... rename frontend to model_format	2022-09-22 13:24:05 +08:00
heliqi	a8e447f225	yolov5 servitization optimization (#262) ... * yolov5 split pre and post process * yolov5 postprocess * yolov5 postprocess	2022-09-21 18:22:39 +08:00
Jason	addce837bc	Add paddlelite backend support (#260) ... * Add paddlelite backend support * Update CMakeLists.txt * Update __init__.py	2022-09-21 13:22:34 +08:00
Jason	74f1143aba	Support disable logging information (#254) ... * Support disable logging information * Support disable logging information	2022-09-20 15:44:10 +08:00
Jason	68523be411	Modify file structure to separate python and cpp code (#223) ... Modify code structure	2022-09-14 15:44:13 +08:00
Jason	ffbc5cc42d	Move cpp code to directory csrcs (#42) ... * move cpp code to csrcs * move cpp code to csrcs	2022-07-26 17:59:02 +08:00
Jason	027f3dd86d	Fix some compile problem in Linux (#41) ... * Add custom operator for onnxruntime ans fix paddle backend * Polish cmake files and runtime apis * Remove copy libraries * fix some issue * fix bug * fix bug * Support remove multiclass_nms to enable paddledetection run tensorrt * Support remove multiclass_nms to enable paddledetection run tensorrt * Support remove multiclass_nms to enable paddledetection run tensorrt * Support remove multiclass_nms to enable paddledetection run tensorrt * add common operator multiclassnms * fix compile problem * fix some compile problem in linux * remove debug log Co-authored-by: root <root@bjyz-sys-gpu-kongming3.bjyz.baidu.com>	2022-07-26 16:35:46 +08:00
Jason	279c993483	Polish cmake files and runtime apis (#36) ... * Add custom operator for onnxruntime ans fix paddle backend * Polish cmake files and runtime apis * Remove copy libraries * fix some issue * fix bug * fix bug	2022-07-25 08:59:53 +08:00
Jason	f670520bf8	fix some usage problem in linux (#25) ... Co-authored-by: root <root@bjyz-sys-gpu-kongming3.bjyz.baidu.com>	2022-07-19 11:47:13 +08:00
jiangjiajun	6c5bd8afad	fix compile for python	2022-07-13 02:48:08 +00:00
jiangjiajun	4c07d198ba	add model zoo	2022-07-06 03:12:43 +00:00
jiangjiajun	9d87046d78	first commit	2022-07-05 09:30:15 +00:00