DefTruth
cf1ff2077d
[Bug Fix] fix trt backend page-locked error ( #2095 )
...
* [Bug Fix] fix trt backend page-locked error
* Update trt_backend.cc
2023-07-11 13:49:47 +08:00
DefTruth
7d1b706caf
[Benchmark] Add pure runtime benchmark bin ( #1731 )
...
* [Benchmark] Add pure runtime benchmark bin
* [Benchmark] add cpu/gpu memory collect -> benchmark bin
* [Backend] update trt max_batch_size policy
* [backend] Update trt backend max_batch_size policy
* [Benchmark] Add more model format support -> benchmark bin
2023-03-30 19:03:30 +08:00
Jason
18e33bae5c
[Other] Optimize runtime module ( #1356 )
...
* Optimize runtime
* fix error
* [Backend] Add option to print tensorrt conversion log (#1386 )
Add option to print tensorrt conversion log
Co-authored-by: root <root@bjyz-sys-gpu-kongming3.bjyz.baidu.com >
---------
Co-authored-by: root <root@bjyz-sys-gpu-kongming3.bjyz.baidu.com >
2023-02-21 17:01:32 +08:00
Jason
c5b414a774
[Other] Unify initialize api for lite/trt backend ( #1249 )
...
* Unify initialize api for lite/trt backend
* Unify initialize api for lite/trt backend
2023-02-08 11:16:39 +08:00
DefTruth
f73a538f61
[Backend] support bechmark mode for runtime and backend ( #1201 )
...
* [backend] support bechmark mode for runtime and backend
* [backend] support bechmark mode for runtime and backend
* [pybind11] add benchmark methods pybind
* [pybind11] add benchmark methods pybind
* [Other] Update build scripts
* [Other] Update cmake/summary.cmake
* [Other] update build scripts
* [Other] add ENABLE_BENCHMARK option -> setup.py
* optimize backend time recording
* optimize backend time recording
* optimize trt backend time record
* [backend] optimze backend_time recording for trt
* [benchmark] remove redundant logs
* fixed ov_backend confilct
* [benchmark] fixed paddle_backend conflicts
* [benchmark] fixed paddle_backend conflicts
* [benchmark] fixed paddle_backend conflicts
* [benchmark] remove use_gpu option from ort backend option
* [benchmark] update benchmark_ppdet.py
* [benchmark] update benchmark_ppcls.py
* fixed lite backend conflicts
* [Lite] fixed lite xpu
* add benchmark macro
* add RUNTIME_PROFILE_LOOP macros
* add comments for RUNTIME_PROFILE macros
* add comments for new apis
* add comments for new apis
* update benchmark_ppdet.py
* afixed bugs
* remove unused codes
* optimize RUNTIME_PROFILE_LOOP macros
* optimize RUNTIME_PROFILE_LOOP macros
* add comments for benchmark option and result
* add docs for benchmark namespace
2023-02-06 14:29:35 +08:00
Jason
b4e322af63
[Other] Optimize load model from memory function ( #1205 )
...
Optimize option for runtime
2023-02-01 15:50:38 +08:00
huangjianhui
76df90afc3
[Other] FastDeploy TensorRT && ONNX backend support to load model form memory ( #1130 )
...
* Update all backends load model from buffer
* Delete redundant code
* Format code style
* Format code style
* Delete redundant code
* Delete redundant code
* Add some FDASSERTs
* Update load model form memory when cloning engine
* Update clone engine code
* Update set_model_buffer api parameters with char pointer
* Release memory buffer variables after finish init backends
* Fix conflict
* Fix bug
2023-02-01 11:36:09 +08:00
Jason
df20b2a02b
[Other] Remove useless macros ( #1095 )
...
* Remove useless macros
* triger ci
* fix check error
* rename INTEGRATE_PADDLE2ONNX to ENABLE_PADDLE2ONNX
2023-01-09 21:35:23 +08:00
Jason
4aa4ebd7c3
[Other] [Part2] Upgrade runtime module ( #1080 )
...
[Other] Upgrade runtime module
2023-01-09 13:22:51 +08:00
