Commit Graph

19 Commits

Author SHA1 Message Date
DefTruth
ff631b7838 [Server] Support encrypt & auth for FD Server (#2018)
* [Server] Support GPU encrypt & auth for FD Triton Server

* fix dockerfile proxy env error

* update build scrpits

* remove some logs

---------

Co-authored-by: root <root@yq02-sys-rpm1206692e6.yq02.baidu.com>
Co-authored-by: qiuyanjun <qiuyanjun@baidu.com>
2023-06-13 20:44:25 +08:00
DefTruth
284b1b46c8 [Serving] Support XPU encrypt & auth server (#2007)
* [patchelf] fix patchelf error for inference xpu

* [serving] add xpu dockerfile and support fd server

* [serving] add xpu dockerfile and support fd server

* [Serving] support XPU + Tritron

* [Serving] support XPU + Tritron

* [Dockerfile] update xpu tritron docker file -> paddle 0.0.0

* [Dockerfile] update xpu tritron docker file -> paddle 0.0.0

* [Dockerfile] update xpu tritron docker file -> paddle 0.0.0

* [Dockerfile] add comments for xpu tritron dockerfile

* [Doruntime] fix xpu infer error

* [Doruntime] fix xpu infer error

* [XPU] update xpu dockerfile

* add xpu triton server docs

* add xpu triton server docs

* add xpu triton server docs

* add xpu triton server docs

* update xpu triton server docs

* update xpu triton server docs

* update xpu triton server docs

* update xpu triton server docs

* update xpu triton server docs

* update xpu triton server docs

* update xpu triton server docs

* update xpu triton server docs

* [XPU] Update XPU L3 Cache setting docs

* [XPU] Add Encryption and AUTH support for XPU Server

* [XPU] Add Encryption and AUTH support for XPU Server

* [Bug Fix] fix paddle reader error

* [Serving] Support XPU encrypt & auth server

* [Serving] Support XPU encrypt & auth server

* [Serving] Support XPU encrypt & auth server

* [Serving] Support XPU encrypt & auth server

* [Triton] switch TAG 22.12 -> TAG 21.10wq

* update xpu auth server script
2023-06-01 21:36:44 +08:00
WJJ1995
9a5b291f60 [Serving]Fixed dockerfile (#1978)
* add workspace_size option

* support 11.2 cuda

* fixed dockerfile

---------

Co-authored-by: DefTruth <31974251+DefTruth@users.noreply.github.com>
2023-05-23 16:22:53 +08:00
WJJ1995
ee81605e5d [Serving]Support 11.2 CUDA (#1976)
* add workspace_size option

* support 11.2 cuda

---------

Co-authored-by: DefTruth <31974251+DefTruth@users.noreply.github.com>
2023-05-23 15:16:07 +08:00
heliqi
3e7cb88049 [Serving]support 22.12 (#1974)
support 22.12
2023-05-22 22:27:13 +08:00
Zeref996
b8f8f09e37 fix dockerfile paddle install url 2023-03-21 10:47:06 +08:00
Zeref996
be313a859b fix serving/Dockerfile (#1397)
* fix serving/Dockerfile

* fix download paddlepaddle
2023-02-27 10:32:28 +08:00
Jack Zhou
ee41944f47 [Serving] Update trt backend to 8.5.2.2 (#1326)
* update trt backend

* Add trt version args

* Add cuda cudnn version
2023-02-17 14:05:04 +08:00
Zeref996
1f1dfc6c75 fix serving/Dockerfile, unset http_proxy (#1199)
* fix serving/Dockerfile, unset http_proxy

* fix serving/Dockerfile 1, unset http_proxy
2023-01-31 17:49:53 +08:00
Zeref996
5ea3cb0fd8 fix serving/Dockerfile (#1082) 2023-01-06 16:38:17 +08:00
Zeref996
edc18c9fc8 fix serving/Dockerfile http_proxy (#1066)
fix serving/Dockerfile
2023-01-05 13:39:40 +08:00
heliqi
97a0a9e33f [Serving]Update Dockerfile (#1049)
Update Dockerfile
2023-01-04 14:48:29 +08:00
heliqi
0ead9d27c2 [Serving]modify docker images name (#992)
* modify docker images name

* Update Dockerfile_cpu
2022-12-27 21:29:27 +08:00
heliqi
dd18471b41 [Doc][Serving]modify serving doc (#718)
modify serving doc
2022-11-28 15:14:10 +08:00
Jack Zhou
eeae48deff [Other] faster_tokenizer->fast_tokenizer (#636)
* faster_tokenizer->fast_tokenizer

* ErnieFasterTokenizer->ErnieFastTokenizer

* update the fastdeploy_init

Co-authored-by: Jason <jiangjiajun@baidu.com>
2022-11-21 13:45:00 +08:00
heliqi
2f73857b2b [Serving]Update images version to 0.6.0 (#594)
* serving images update to 0.6

* serving images update to 0.6

* serving images update to 0.6
2022-11-16 10:11:43 +08:00
heliqi
2693434190 [Serving]optimize serving build script (#569)
* optimizer serving build

* optimizer serving build

* optimizer serving build
2022-11-12 14:01:50 +08:00
heliqi
8a3ad3eb43 fix input name bug (#352) 2022-10-13 11:49:27 +08:00
heliqi
d57e997fa0 Fd serving add docker images correlation and docs (#311)
* fd serving add dockerfile

* fix enable_paddle_mkldnn

* delete disable_paddle_mkldnn

Co-authored-by: Jason <jiangjiajun@baidu.com>
2022-10-08 16:08:07 +08:00