DefTruth
6a8cd4d759
[Backend] support ort offline graph optimize option ( #2268 )
...
* support ort offline graph optimize option
* support ort offline graph optimize option
2023-11-02 09:19:33 +08:00
DefTruth
77ee48f9b8
[Bug Fix] fixed compile error for cpu building ( #2105 )
...
* [cmake] upgrade windows paddle inference -> 2.5.0
* [cmake] upgrade windows paddle inference -> 2.5.0
* fix paddle custom ops bug on windows
* [Backend] refactor paddle custom ops
* [Bug Fix] fixed paddle custom ops windows build error
* [Bug Fix] fixed compile error for cpu building
2023-07-13 17:02:25 +08:00
DefTruth
b2426aefa9
[Backend] add paddle custom ops compatible policy ( #2070 )
...
* Add centerpoint
* fix postprocess op file name
* [Backend] add paddle custom ops compatible policy
* [Backend] add paddle custom ops compatible policy
* [Backend] add paddle custom ops compatible policy
* upgrade linx paddle gpu -> 2.5
* add custom op compatible policy for paddle 2.5
* add custom op compatible policy for paddle 2.5
* add custom op compatible policy for paddle 2.5
* add collect_trt_shape_by_device option for paddle backend
* add collect_trt_shape_by_device option for paddle backend
* add custom op option for python build
* fix python build bugs
* update paddle linux x86 cpu only lib
* update paddle linux gpu lib
* update patchelf cmake
* fix paddle backend option pybind
* update paddle_inference.cmake
* add cuda sm_80 support (A100)
---------
Co-authored-by: zengshao0622 <peter_z96@163.com >
Co-authored-by: qiuyanjun <qiuyanjun@baidu.com >
2023-06-29 22:32:14 +08:00
DefTruth
ff631b7838
[Server] Support encrypt & auth for FD Server ( #2018 )
...
* [Server] Support GPU encrypt & auth for FD Triton Server
* fix dockerfile proxy env error
* update build scrpits
* remove some logs
---------
Co-authored-by: root <root@yq02-sys-rpm1206692e6.yq02.baidu.com >
Co-authored-by: qiuyanjun <qiuyanjun@baidu.com >
2023-06-13 20:44:25 +08:00
DefTruth
49c033a828
[XPU] Support XPU via Paddle Inference backend ( #1987 )
...
* [backend] Support XPU via Paddle Inference backend
* [backend] Support XPU via Paddle Inference backend
* [backend] Support XPU via Paddle Inference backend
* [XPU] support XPU benchmark via paddle inference
* [XPU] support XPU benchmark via paddle inference
* [benchmark] add xpu paddle h2d config files
2023-05-25 14:13:40 +08:00
DefTruth
33e07410da
[cmake] Support custom paddle inference url ( #1939 )
...
* [cmake] Support custom paddle inference url
* [Python] Add custom Paddle Inference URL support for python
* [Docker] Add fd serving Dockerfile for paddle2.4.2
* [Docker] Add fd serving Dockerfile for paddle2.4.2
* [Docker] Add fd serving Dockerfile for paddle2.4.2
* [Docker] Add fd serving Dockerfile for paddle2.4.2
* [Bug Fix] fixed result format string error
* rerunning the re-touch CIs
* rerunning CIs
2023-05-16 14:30:31 +08:00
DefTruth
15c29f7e49
[Python] Add backward compatible for paddle2.4.2 ( #1929 )
...
* [Python] Add backward compatible for paddle2.4.2
* [Python] Add backward compatible for paddle2.4.2
* [scripts] update linux build scripts
2023-05-11 19:34:06 +08:00
DefTruth
9ec419129f
[XPU] Update Lite XPU lib to fix l3 cache crash for seg models ( #1786 )
...
* Update kunlunxin.cmake
* [XPU] Update Lite XPU lib to fix l3 cache crash
2023-04-11 18:01:52 +08:00
DefTruth
95f809c1ff
[Bug Fix] fix build error while enable flycv on linux x64 ( #1365 )
...
* [Bug Fix] fix build error while enable flycv on linux x64
* [Bug Fix] fix build error while enable flycv on linux x64
* move WITH_FLYCV_STATIC option -> flycv.cmake
2023-02-20 13:52:31 +08:00
DefTruth
ce424c313e
[XPU] Add XPU option for benchmark example ( #1287 )
...
* [XPU] Add xpu option for benchmark example
* [XPU] Add fp16 flags
2023-02-10 11:24:40 +08:00
DefTruth
ab5377b5fa
[Benchmark] Add PaddleYOLOv8 cpp benchmark example & lite flags option ( #1270 )
...
* [Android] Add PaddleYOLOv8 cpp benchmark example & lite flags option
* [Benchmark] add linux x86_64 gpu benchmark build script
2023-02-09 11:58:07 +08:00
DefTruth
f73a538f61
[Backend] support bechmark mode for runtime and backend ( #1201 )
...
* [backend] support bechmark mode for runtime and backend
* [backend] support bechmark mode for runtime and backend
* [pybind11] add benchmark methods pybind
* [pybind11] add benchmark methods pybind
* [Other] Update build scripts
* [Other] Update cmake/summary.cmake
* [Other] update build scripts
* [Other] add ENABLE_BENCHMARK option -> setup.py
* optimize backend time recording
* optimize backend time recording
* optimize trt backend time record
* [backend] optimze backend_time recording for trt
* [benchmark] remove redundant logs
* fixed ov_backend confilct
* [benchmark] fixed paddle_backend conflicts
* [benchmark] fixed paddle_backend conflicts
* [benchmark] fixed paddle_backend conflicts
* [benchmark] remove use_gpu option from ort backend option
* [benchmark] update benchmark_ppdet.py
* [benchmark] update benchmark_ppcls.py
* fixed lite backend conflicts
* [Lite] fixed lite xpu
* add benchmark macro
* add RUNTIME_PROFILE_LOOP macros
* add comments for RUNTIME_PROFILE macros
* add comments for new apis
* add comments for new apis
* update benchmark_ppdet.py
* afixed bugs
* remove unused codes
* optimize RUNTIME_PROFILE_LOOP macros
* optimize RUNTIME_PROFILE_LOOP macros
* add comments for benchmark option and result
* add docs for benchmark namespace
2023-02-06 14:29:35 +08:00
