Jason
|
c5b414a774
|
[Other] Unify initialize api for lite/trt backend (#1249)
* Unify initialize api for lite/trt backend
* Unify initialize api for lite/trt backend
|
2023-02-08 11:16:39 +08:00 |
|
Jason
|
713afe7f1c
|
[Other] Deprecate some option api and parameters (#1243)
* Optimize Poros backend
* fix error
* Add more pybind
* fix conflicts
* add some deprecate notices
* [Other] Deprecate some apis in RuntimeOption (#1240)
* Deprecate more options
* modify serving
* Update option.h
* fix tensorrt error
* Update option_pybind.cc
* Update option_pybind.cc
* Fix error in serving
* fix word spell error
|
2023-02-07 17:57:46 +08:00 |
|
DefTruth
|
f73a538f61
|
[Backend] support bechmark mode for runtime and backend (#1201)
* [backend] support bechmark mode for runtime and backend
* [backend] support bechmark mode for runtime and backend
* [pybind11] add benchmark methods pybind
* [pybind11] add benchmark methods pybind
* [Other] Update build scripts
* [Other] Update cmake/summary.cmake
* [Other] update build scripts
* [Other] add ENABLE_BENCHMARK option -> setup.py
* optimize backend time recording
* optimize backend time recording
* optimize trt backend time record
* [backend] optimze backend_time recording for trt
* [benchmark] remove redundant logs
* fixed ov_backend confilct
* [benchmark] fixed paddle_backend conflicts
* [benchmark] fixed paddle_backend conflicts
* [benchmark] fixed paddle_backend conflicts
* [benchmark] remove use_gpu option from ort backend option
* [benchmark] update benchmark_ppdet.py
* [benchmark] update benchmark_ppcls.py
* fixed lite backend conflicts
* [Lite] fixed lite xpu
* add benchmark macro
* add RUNTIME_PROFILE_LOOP macros
* add comments for RUNTIME_PROFILE macros
* add comments for new apis
* add comments for new apis
* update benchmark_ppdet.py
* afixed bugs
* remove unused codes
* optimize RUNTIME_PROFILE_LOOP macros
* optimize RUNTIME_PROFILE_LOOP macros
* add comments for benchmark option and result
* add docs for benchmark namespace
|
2023-02-06 14:29:35 +08:00 |
|
Jason
|
b4e322af63
|
[Other] Optimize load model from memory function (#1205)
Optimize option for runtime
|
2023-02-01 15:50:38 +08:00 |
|
huangjianhui
|
76df90afc3
|
[Other] FastDeploy TensorRT && ONNX backend support to load model form memory (#1130)
* Update all backends load model from buffer
* Delete redundant code
* Format code style
* Format code style
* Delete redundant code
* Delete redundant code
* Add some FDASSERTs
* Update load model form memory when cloning engine
* Update clone engine code
* Update set_model_buffer api parameters with char pointer
* Release memory buffer variables after finish init backends
* Fix conflict
* Fix bug
|
2023-02-01 11:36:09 +08:00 |
|
yeliang2258
|
829fe0721d
|
[Backend] Add TensorRT FP16 support for AdaptivePool2d (#1116)
* add fp16 cuda kernel
* fix code bug
* update code
|
2023-01-13 19:44:00 +08:00 |
|
Jason
|
fc314f1696
|
[Other] Rename directory op_cuda_kernels to common/cuda (#1104)
rename directory name
|
2023-01-10 16:31:37 +08:00 |
|
Jason
|
df20b2a02b
|
[Other] Remove useless macros (#1095)
* Remove useless macros
* triger ci
* fix check error
* rename INTEGRATE_PADDLE2ONNX to ENABLE_PADDLE2ONNX
|
2023-01-09 21:35:23 +08:00 |
|
Jason
|
4aa4ebd7c3
|
[Other] [Part2] Upgrade runtime module (#1080)
[Other] Upgrade runtime module
|
2023-01-09 13:22:51 +08:00 |
|