Commit Graph

17 Commits

Author SHA1 Message Date
DefTruth
284b1b46c8 [Serving] Support XPU encrypt & auth server (#2007)
* [patchelf] fix patchelf error for inference xpu

* [serving] add xpu dockerfile and support fd server

* [serving] add xpu dockerfile and support fd server

* [Serving] support XPU + Tritron

* [Serving] support XPU + Tritron

* [Dockerfile] update xpu tritron docker file -> paddle 0.0.0

* [Dockerfile] update xpu tritron docker file -> paddle 0.0.0

* [Dockerfile] update xpu tritron docker file -> paddle 0.0.0

* [Dockerfile] add comments for xpu tritron dockerfile

* [Doruntime] fix xpu infer error

* [Doruntime] fix xpu infer error

* [XPU] update xpu dockerfile

* add xpu triton server docs

* add xpu triton server docs

* add xpu triton server docs

* add xpu triton server docs

* update xpu triton server docs

* update xpu triton server docs

* update xpu triton server docs

* update xpu triton server docs

* update xpu triton server docs

* update xpu triton server docs

* update xpu triton server docs

* update xpu triton server docs

* [XPU] Update XPU L3 Cache setting docs

* [XPU] Add Encryption and AUTH support for XPU Server

* [XPU] Add Encryption and AUTH support for XPU Server

* [Bug Fix] fix paddle reader error

* [Serving] Support XPU encrypt & auth server

* [Serving] Support XPU encrypt & auth server

* [Serving] Support XPU encrypt & auth server

* [Serving] Support XPU encrypt & auth server

* [Triton] switch TAG 22.12 -> TAG 21.10wq

* update xpu auth server script
2023-06-01 21:36:44 +08:00
WJJ1995
ee81605e5d [Serving]Support 11.2 CUDA (#1976)
* add workspace_size option

* support 11.2 cuda

---------

Co-authored-by: DefTruth <31974251+DefTruth@users.noreply.github.com>
2023-05-23 15:16:07 +08:00
heliqi
3e7cb88049 [Serving]support 22.12 (#1974)
support 22.12
2023-05-22 22:27:13 +08:00
zhoushunjie
f3daf90f4d Set proxy when compile serving 2023-03-15 13:05:19 +00:00
zhoushunjie
1b1f68499e fix trt version bug 2023-02-22 08:37:25 +00:00
Jack Zhou
1b499f3de2 [Serving] Update serving build script (#1371)
Update serving build script
2023-02-20 15:30:49 +08:00
Jack Zhou
ee41944f47 [Serving] Update trt backend to 8.5.2.2 (#1326)
* update trt backend

* Add trt version args

* Add cuda cudnn version
2023-02-17 14:05:04 +08:00
Jason
df20b2a02b [Other] Remove useless macros (#1095)
* Remove useless macros

* triger ci

* fix check error

* rename INTEGRATE_PADDLE2ONNX to ENABLE_PADDLE2ONNX
2023-01-09 21:35:23 +08:00
Zeref996
cb7e10277e Fix serving/scripts build.sh (#1053)
* fix serving/scripts build.sh

* Update build.sh

support:
```
bash build.sh --docker_name=test
```

* Update build.sh

Co-authored-by: heliqi <1101791222@qq.com>
2023-01-04 17:42:51 +08:00
heliqi
5dca3a45c9 [backend][Serving]Fix paddle backend get outout tensor error (#741)
fix paddle backend no_copy_infer
2022-11-29 18:34:56 +08:00
Zeref996
27e68a04e7 fix serving/scripts/build.sh for docker build CI task (#688)
* fix serving/scripts/build.sh for docker build CI task

* Update build.sh

Co-authored-by: heliqi <1101791222@qq.com>
2022-11-24 14:32:13 +08:00
Zeref996
521ec87cf5 add http params in serving/scripts/build.sh (#661)
* add http params in serving/scripts/build.sh

* Update build.sh

Co-authored-by: heliqi <1101791222@qq.com>
2022-11-22 19:59:39 +08:00
heliqi
2f73857b2b [Serving]Update images version to 0.6.0 (#594)
* serving images update to 0.6

* serving images update to 0.6

* serving images update to 0.6
2022-11-16 10:11:43 +08:00
heliqi
2693434190 [Serving]optimize serving build script (#569)
* optimizer serving build

* optimizer serving build

* optimizer serving build
2022-11-12 14:01:50 +08:00
heliqi
c30df2021f [Serving]cpu images fix python core (#401)
serving cpu fix python core
2022-10-20 11:55:15 +08:00
heliqi
5328fbc861 support build cpu images (#341) 2022-10-11 14:17:27 +08:00
heliqi
d57e997fa0 Fd serving add docker images correlation and docs (#311)
* fd serving add dockerfile

* fix enable_paddle_mkldnn

* delete disable_paddle_mkldnn

Co-authored-by: Jason <jiangjiajun@baidu.com>
2022-10-08 16:08:07 +08:00