DefTruth
|
434b48dda5
|
[Serving] Support FastDeploy XPU Triton Server (#1994)
* [patchelf] fix patchelf error for inference xpu
* [serving] add xpu dockerfile and support fd server
* [serving] add xpu dockerfile and support fd server
* [Serving] support XPU + Tritron
* [Serving] support XPU + Tritron
* [Dockerfile] update xpu tritron docker file -> paddle 0.0.0
* [Dockerfile] update xpu tritron docker file -> paddle 0.0.0
* [Dockerfile] update xpu tritron docker file -> paddle 0.0.0
* [Dockerfile] add comments for xpu tritron dockerfile
* [Doruntime] fix xpu infer error
* [Doruntime] fix xpu infer error
* [XPU] update xpu dockerfile
* add xpu triton server docs
* add xpu triton server docs
* add xpu triton server docs
* add xpu triton server docs
* update xpu triton server docs
* update xpu triton server docs
* update xpu triton server docs
* update xpu triton server docs
* update xpu triton server docs
* update xpu triton server docs
* update xpu triton server docs
* update xpu triton server docs
|
2023-05-29 14:38:25 +08:00 |
|
heliqi
|
3e7cb88049
|
[Serving]support 22.12 (#1974)
support 22.12
|
2023-05-22 22:27:13 +08:00 |
|
WJJ1995
|
92fcee6c3b
|
[Serving] Add trt workspace_size option for serving (#1963)
add workspace_size option
Co-authored-by: DefTruth <31974251+DefTruth@users.noreply.github.com>
|
2023-05-19 11:29:58 +08:00 |
|
DefTruth
|
652024d2f6
|
Revert "Remove Paddle Reader" (#1860)
Revert "Remove Paddle Reader (#1813)"
This reverts commit f3d44785c4.
|
2023-04-23 23:16:31 +08:00 |
|
Jason
|
f3d44785c4
|
Remove Paddle Reader (#1813)
* Remove Paddle Reader
* support pp-infer c++14
* disable trt cache
---------
Co-authored-by: wang-xinyu <wangxinyu_es@163.com>
|
2023-04-20 21:12:43 +08:00 |
|
Jack Zhou
|
012c7771c1
|
[Serving] Add collect shape and fix serving infer (#1658)
Add collect shape and fix serving infer
|
2023-03-20 19:55:30 +08:00 |
|
zhoushunjie
|
cd9cb577fe
|
disable_trt_ops->delete_passes
|
2023-03-09 06:14:53 +00:00 |
|
zhoushunjie
|
90942a7ada
|
DisablePaddleTrtOP->DisableTrtOps
|
2023-03-09 06:01:48 +00:00 |
|
zhoushunjie
|
f88b06a4ff
|
Add delete pass, disable_trt_ops and enable_fixed_size_opt for serving
|
2023-03-09 03:18:22 +00:00 |
|
heliqi
|
8f21d55e5c
|
[Serving]support encryt (#1349)
* serving support encryt
* Update fastdeploy_runtime.cc
|
2023-02-17 15:29:57 +08:00 |
|
Jason
|
713afe7f1c
|
[Other] Deprecate some option api and parameters (#1243)
* Optimize Poros backend
* fix error
* Add more pybind
* fix conflicts
* add some deprecate notices
* [Other] Deprecate some apis in RuntimeOption (#1240)
* Deprecate more options
* modify serving
* Update option.h
* fix tensorrt error
* Update option_pybind.cc
* Update option_pybind.cc
* Fix error in serving
* fix word spell error
|
2023-02-07 17:57:46 +08:00 |
|
heliqi
|
42f1888bb0
|
[Serving][Backend] Backend support zero_copy_infer and Serving reduce the output memory copy (#703)
* backend add zero copy infer interface
* fix bug
* fix bug
* fix bug
* paddle ipu
|
2022-11-28 14:07:53 +08:00 |
|
heliqi
|
277bec38c7
|
[Backend & Serving] Serving and Runtime support Clone (#464)
* Add Serving and Runtime use Clone
* support TRT, OpenVINO and Paddle Backend
Co-authored-by: Jason <jiangjiajun@baidu.com>
|
2022-11-04 17:16:40 +08:00 |
|
czr-gc
|
da84da7448
|
[Serving]: add ipu support for serving. (#10) (#470)
* feat(ipu): add ipu docker for serving. (#10)
* feat(ipu): add ipu docker for serving.
* feat(ipu): enable ipu docker in serving.
* fix(): fix typo and issues in IPU.
* remove unused env path.
* doc(ipu): add ipu docker build doc and fix typo.
* fix(): clean apt cache in docker.
* fix(ipu): fix typo.
|
2022-11-02 09:50:58 +08:00 |
|
heliqi
|
b064ddf7ed
|
[Serving][backend]serving support multi stream and backend support external stream (#431)
* serving support multi stream
* pybind add external stream
Co-authored-by: Jason <jiangjiajun@baidu.com>
|
2022-10-26 14:46:13 +08:00 |
|
heliqi
|
587ffd4caf
|
[Serving]add ernie-3.0 demo (#399)
serving add ernie-3.0 demo
|
2022-10-20 15:29:47 +08:00 |
|
heliqi
|
831ef42207
|
fix paddle-mkldnn bug (#366)
* fix input name bug
* fix paddle-mkldnn bug
|
2022-10-13 21:37:31 +08:00 |
|
heliqi
|
8a3ad3eb43
|
fix input name bug (#352)
|
2022-10-13 11:49:27 +08:00 |
|
heliqi
|
5328fbc861
|
support build cpu images (#341)
|
2022-10-11 14:17:27 +08:00 |
|
heliqi
|
d57e997fa0
|
Fd serving add docker images correlation and docs (#311)
* fd serving add dockerfile
* fix enable_paddle_mkldnn
* delete disable_paddle_mkldnn
Co-authored-by: Jason <jiangjiajun@baidu.com>
|
2022-10-08 16:08:07 +08:00 |
|
heliqi
|
69be5b5232
|
fastdeploy support serving (#272)
* fd support serving
* fd support serving optimize dir
* optimize code
Co-authored-by: Jason <jiangjiajun@baidu.com>
|
2022-09-27 14:07:19 +08:00 |
|