yeliang2258
cae341e6c5
[Backend] Add fp16 support for ONNXRuntime-GPU ( #1239 )
...
* add fp16 support for ort-gpu
* add enable_ort_fp16 option
* fix
* fix bugs
* use fp16 for test
* update code
* update code
* fix windows bug
2023-03-23 18:23:13 +08:00
yunyaoXYY
b3e16e9966
ORT support UINT8 and INT8 input and output
2023-03-21 02:23:23 +00:00
Jason
3d36e26b8a
[Backend] Remove some deprecated api ( #1574 )
...
Remove some deprecated api
2023-03-13 13:42:43 +08:00
Jason
6be2c0367b
[Example] Update runtime examples ( #1542 )
...
* Add notes for tensors
* Optimize some apis
* move some warnings
2023-03-08 16:56:04 +08:00
yunyaoXYY
c38b7d4377
[Backend] Support onnxruntime DirectML inference. ( #1304 )
...
* Fix links in readme
* Fix links in readme
* Update PPOCRv2/v3 examples
* Update auto compression configs
* Add neww quantization support for paddleclas model
* Update quantized Yolov6s model download link
* Improve PPOCR comments
* Add English doc for quantization
* Fix PPOCR rec model bug
* Add new paddleseg quantization support
* Add new paddleseg quantization support
* Add new paddleseg quantization support
* Add new paddleseg quantization support
* Add Ascend model list
* Add ascend model list
* Add ascend model list
* Add ascend model list
* Add ascend model list
* Add ascend model list
* Add ascend model list
* Support DirectML in onnxruntime
* Support onnxruntime DirectML
* Support onnxruntime DirectML
* Support onnxruntime DirectML
* Support OnnxRuntime DirectML
* Support OnnxRuntime DirectML
* Support OnnxRuntime DirectML
* Support OnnxRuntime DirectML
* Support OnnxRuntime DirectML
* Support OnnxRuntime DirectML
* Support OnnxRuntime DirectML
* Support OnnxRuntime DirectML
* Remove DirectML vision model example
* Imporve OnnxRuntime DirectML
* Imporve OnnxRuntime DirectML
* fix opencv cmake in Windows
* recheck codestyle
2023-02-17 10:53:51 +08:00
Jason
713afe7f1c
[Other] Deprecate some option api and parameters ( #1243 )
...
* Optimize Poros backend
* fix error
* Add more pybind
* fix conflicts
* add some deprecate notices
* [Other] Deprecate some apis in RuntimeOption (#1240 )
* Deprecate more options
* modify serving
* Update option.h
* fix tensorrt error
* Update option_pybind.cc
* Update option_pybind.cc
* Fix error in serving
* fix word spell error
2023-02-07 17:57:46 +08:00
Jason
7c9bf11c44
[Other] Optimize Poros backend ( #1232 )
...
* Optimize Poros backend
* fix error
* Add more pybind
* fix conflicts
* add some deprecate notices
2023-02-07 10:18:03 +08:00
DefTruth
f73a538f61
[Backend] support bechmark mode for runtime and backend ( #1201 )
...
* [backend] support bechmark mode for runtime and backend
* [backend] support bechmark mode for runtime and backend
* [pybind11] add benchmark methods pybind
* [pybind11] add benchmark methods pybind
* [Other] Update build scripts
* [Other] Update cmake/summary.cmake
* [Other] update build scripts
* [Other] add ENABLE_BENCHMARK option -> setup.py
* optimize backend time recording
* optimize backend time recording
* optimize trt backend time record
* [backend] optimze backend_time recording for trt
* [benchmark] remove redundant logs
* fixed ov_backend confilct
* [benchmark] fixed paddle_backend conflicts
* [benchmark] fixed paddle_backend conflicts
* [benchmark] fixed paddle_backend conflicts
* [benchmark] remove use_gpu option from ort backend option
* [benchmark] update benchmark_ppdet.py
* [benchmark] update benchmark_ppcls.py
* fixed lite backend conflicts
* [Lite] fixed lite xpu
* add benchmark macro
* add RUNTIME_PROFILE_LOOP macros
* add comments for RUNTIME_PROFILE macros
* add comments for new apis
* add comments for new apis
* update benchmark_ppdet.py
* afixed bugs
* remove unused codes
* optimize RUNTIME_PROFILE_LOOP macros
* optimize RUNTIME_PROFILE_LOOP macros
* add comments for benchmark option and result
* add docs for benchmark namespace
2023-02-06 14:29:35 +08:00
Jason
a711f99c69
[Other] Optimize runtime module ( #1211 )
...
* modify ort option
* update code
* Unify backend
2023-02-02 13:10:40 +08:00
huangjianhui
76df90afc3
[Other] FastDeploy TensorRT && ONNX backend support to load model form memory ( #1130 )
...
* Update all backends load model from buffer
* Delete redundant code
* Format code style
* Format code style
* Delete redundant code
* Delete redundant code
* Add some FDASSERTs
* Update load model form memory when cloning engine
* Update clone engine code
* Update set_model_buffer api parameters with char pointer
* Release memory buffer variables after finish init backends
* Fix conflict
* Fix bug
2023-02-01 11:36:09 +08:00
Jason
fc314f1696
[Other] Rename directory op_cuda_kernels to common/cuda ( #1104 )
...
rename directory name
2023-01-10 16:31:37 +08:00
Jason
df20b2a02b
[Other] Remove useless macros ( #1095 )
...
* Remove useless macros
* triger ci
* fix check error
* rename INTEGRATE_PADDLE2ONNX to ENABLE_PADDLE2ONNX
2023-01-09 21:35:23 +08:00
Jason
4aa4ebd7c3
[Other] [Part2] Upgrade runtime module ( #1080 )
...
[Other] Upgrade runtime module
2023-01-09 13:22:51 +08:00
