zhoushunjie
|
cd9cb577fe
|
disable_trt_ops->delete_passes
|
2023-03-09 06:14:53 +00:00 |
|
zhoushunjie
|
90942a7ada
|
DisablePaddleTrtOP->DisableTrtOps
|
2023-03-09 06:01:48 +00:00 |
|
zhoushunjie
|
f88b06a4ff
|
Add delete pass, disable_trt_ops and enable_fixed_size_opt for serving
|
2023-03-09 03:18:22 +00:00 |
|
heliqi
|
8f21d55e5c
|
[Serving]support encryt (#1349)
* serving support encryt
* Update fastdeploy_runtime.cc
|
2023-02-17 15:29:57 +08:00 |
|
Jason
|
713afe7f1c
|
[Other] Deprecate some option api and parameters (#1243)
* Optimize Poros backend
* fix error
* Add more pybind
* fix conflicts
* add some deprecate notices
* [Other] Deprecate some apis in RuntimeOption (#1240)
* Deprecate more options
* modify serving
* Update option.h
* fix tensorrt error
* Update option_pybind.cc
* Update option_pybind.cc
* Fix error in serving
* fix word spell error
|
2023-02-07 17:57:46 +08:00 |
|
heliqi
|
42f1888bb0
|
[Serving][Backend] Backend support zero_copy_infer and Serving reduce the output memory copy (#703)
* backend add zero copy infer interface
* fix bug
* fix bug
* fix bug
* paddle ipu
|
2022-11-28 14:07:53 +08:00 |
|
heliqi
|
277bec38c7
|
[Backend & Serving] Serving and Runtime support Clone (#464)
* Add Serving and Runtime use Clone
* support TRT, OpenVINO and Paddle Backend
Co-authored-by: Jason <jiangjiajun@baidu.com>
|
2022-11-04 17:16:40 +08:00 |
|
czr-gc
|
da84da7448
|
[Serving]: add ipu support for serving. (#10) (#470)
* feat(ipu): add ipu docker for serving. (#10)
* feat(ipu): add ipu docker for serving.
* feat(ipu): enable ipu docker in serving.
* fix(): fix typo and issues in IPU.
* remove unused env path.
* doc(ipu): add ipu docker build doc and fix typo.
* fix(): clean apt cache in docker.
* fix(ipu): fix typo.
|
2022-11-02 09:50:58 +08:00 |
|
heliqi
|
b064ddf7ed
|
[Serving][backend]serving support multi stream and backend support external stream (#431)
* serving support multi stream
* pybind add external stream
Co-authored-by: Jason <jiangjiajun@baidu.com>
|
2022-10-26 14:46:13 +08:00 |
|
heliqi
|
587ffd4caf
|
[Serving]add ernie-3.0 demo (#399)
serving add ernie-3.0 demo
|
2022-10-20 15:29:47 +08:00 |
|
heliqi
|
831ef42207
|
fix paddle-mkldnn bug (#366)
* fix input name bug
* fix paddle-mkldnn bug
|
2022-10-13 21:37:31 +08:00 |
|
heliqi
|
8a3ad3eb43
|
fix input name bug (#352)
|
2022-10-13 11:49:27 +08:00 |
|
heliqi
|
5328fbc861
|
support build cpu images (#341)
|
2022-10-11 14:17:27 +08:00 |
|
heliqi
|
d57e997fa0
|
Fd serving add docker images correlation and docs (#311)
* fd serving add dockerfile
* fix enable_paddle_mkldnn
* delete disable_paddle_mkldnn
Co-authored-by: Jason <jiangjiajun@baidu.com>
|
2022-10-08 16:08:07 +08:00 |
|
heliqi
|
69be5b5232
|
fastdeploy support serving (#272)
* fd support serving
* fd support serving optimize dir
* optimize code
Co-authored-by: Jason <jiangjiajun@baidu.com>
|
2022-09-27 14:07:19 +08:00 |
|