Jiang-Jia-Jun
d4bbdbefea
Merge pull request #2559 from MaaXYZ/fix/build_error
...
fix: build error without ENABLE_PADDLE2ONNX
2025-01-10 13:55:49 +08:00
MistEO
11214a642f
fix: typo of log
2024-11-21 16:11:31 +08:00
MistEO
2507a172f8
feat: select adapter id for DirectML
2024-11-20 14:38:32 +08:00
MistEO
eca2ae8b94
fix: build error without ENABLE_PADDLE2ONNX
2024-11-19 16:37:46 +08:00
ChaoII
0ae0dc9d82
[BUG FIX] fix memory leak for ort backend
2024-03-29 09:00:05 +08:00
DefTruth
cfebd24dfc
[Backend] fix ort backend windows build error ( #2269 )
...
* support ort offline graph optimize option
* support ort offline graph optimize option
* [Backend] fix windows build error
2023-11-02 12:51:46 +08:00
DefTruth
6a8cd4d759
[Backend] support ort offline graph optimize option ( #2268 )
...
* support ort offline graph optimize option
* support ort offline graph optimize option
2023-11-02 09:19:33 +08:00
yeliang2258
ad1f46f7d9
Add ORT fp16 support in server ( #2069 )
...
* add ort fp16 support in server
* update paddle2onnx url
* update ort fp16 api
* add disable_ort_fp16_op_types in serving
2023-07-05 17:50:00 +08:00
yeliang2258
cae341e6c5
[Backend] Add fp16 support for ONNXRuntime-GPU ( #1239 )
...
* add fp16 support for ort-gpu
* add enable_ort_fp16 option
* fix
* fix bugs
* use fp16 for test
* update code
* update code
* fix windows bug
2023-03-23 18:23:13 +08:00
yunyaoXYY
b3e16e9966
ORT support UINT8 and INT8 input and output
2023-03-21 02:23:23 +00:00
Jason
3d36e26b8a
[Backend] Remove some deprecated api ( #1574 )
...
Remove some deprecated api
2023-03-13 13:42:43 +08:00
yunyaoXYY
c38b7d4377
[Backend] Support onnxruntime DirectML inference. ( #1304 )
...
* Fix links in readme
* Fix links in readme
* Update PPOCRv2/v3 examples
* Update auto compression configs
* Add neww quantization support for paddleclas model
* Update quantized Yolov6s model download link
* Improve PPOCR comments
* Add English doc for quantization
* Fix PPOCR rec model bug
* Add new paddleseg quantization support
* Add new paddleseg quantization support
* Add new paddleseg quantization support
* Add new paddleseg quantization support
* Add Ascend model list
* Add ascend model list
* Add ascend model list
* Add ascend model list
* Add ascend model list
* Add ascend model list
* Add ascend model list
* Support DirectML in onnxruntime
* Support onnxruntime DirectML
* Support onnxruntime DirectML
* Support onnxruntime DirectML
* Support OnnxRuntime DirectML
* Support OnnxRuntime DirectML
* Support OnnxRuntime DirectML
* Support OnnxRuntime DirectML
* Support OnnxRuntime DirectML
* Support OnnxRuntime DirectML
* Support OnnxRuntime DirectML
* Support OnnxRuntime DirectML
* Remove DirectML vision model example
* Imporve OnnxRuntime DirectML
* Imporve OnnxRuntime DirectML
* fix opencv cmake in Windows
* recheck codestyle
2023-02-17 10:53:51 +08:00
DefTruth
f73a538f61
[Backend] support bechmark mode for runtime and backend ( #1201 )
...
* [backend] support bechmark mode for runtime and backend
* [backend] support bechmark mode for runtime and backend
* [pybind11] add benchmark methods pybind
* [pybind11] add benchmark methods pybind
* [Other] Update build scripts
* [Other] Update cmake/summary.cmake
* [Other] update build scripts
* [Other] add ENABLE_BENCHMARK option -> setup.py
* optimize backend time recording
* optimize backend time recording
* optimize trt backend time record
* [backend] optimze backend_time recording for trt
* [benchmark] remove redundant logs
* fixed ov_backend confilct
* [benchmark] fixed paddle_backend conflicts
* [benchmark] fixed paddle_backend conflicts
* [benchmark] fixed paddle_backend conflicts
* [benchmark] remove use_gpu option from ort backend option
* [benchmark] update benchmark_ppdet.py
* [benchmark] update benchmark_ppcls.py
* fixed lite backend conflicts
* [Lite] fixed lite xpu
* add benchmark macro
* add RUNTIME_PROFILE_LOOP macros
* add comments for RUNTIME_PROFILE macros
* add comments for new apis
* add comments for new apis
* update benchmark_ppdet.py
* afixed bugs
* remove unused codes
* optimize RUNTIME_PROFILE_LOOP macros
* optimize RUNTIME_PROFILE_LOOP macros
* add comments for benchmark option and result
* add docs for benchmark namespace
2023-02-06 14:29:35 +08:00
Jason
a711f99c69
[Other] Optimize runtime module ( #1211 )
...
* modify ort option
* update code
* Unify backend
2023-02-02 13:10:40 +08:00
huangjianhui
76df90afc3
[Other] FastDeploy TensorRT && ONNX backend support to load model form memory ( #1130 )
...
* Update all backends load model from buffer
* Delete redundant code
* Format code style
* Format code style
* Delete redundant code
* Delete redundant code
* Add some FDASSERTs
* Update load model form memory when cloning engine
* Update clone engine code
* Update set_model_buffer api parameters with char pointer
* Release memory buffer variables after finish init backends
* Fix conflict
* Fix bug
2023-02-01 11:36:09 +08:00
Jason
df20b2a02b
[Other] Remove useless macros ( #1095 )
...
* Remove useless macros
* triger ci
* fix check error
* rename INTEGRATE_PADDLE2ONNX to ENABLE_PADDLE2ONNX
2023-01-09 21:35:23 +08:00
Jason
4aa4ebd7c3
[Other] [Part2] Upgrade runtime module ( #1080 )
...
[Other] Upgrade runtime module
2023-01-09 13:22:51 +08:00
