apps/FastDeploy
1
0
Fork 0
mirror of https://github.com/PaddlePaddle/FastDeploy.git synced 2025-10-06 17:17:14 +08:00
Code Issues Actions 2 Packages Projects Releases Wiki Activity
2,488 Commits 23 Branches 7 Tags
c521c6ae4c8967a71782a93bb87998f99ee039cb
Commit Graph

26 Commits

Author SHA1 Message Date
DefTruth
12bb44e0de [Bug Fix] fix build xpu encrypt & auth image scripts (#2133) 
* [patchelf] fix patchelf error for inference xpu

* [serving] add xpu dockerfile and support fd server

* [serving] add xpu dockerfile and support fd server

* [Serving] support XPU + Tritron

* [Serving] support XPU + Tritron

* [Dockerfile] update xpu tritron docker file -> paddle 0.0.0

* [Dockerfile] update xpu tritron docker file -> paddle 0.0.0

* [Dockerfile] update xpu tritron docker file -> paddle 0.0.0

* [Dockerfile] add comments for xpu tritron dockerfile

* [Doruntime] fix xpu infer error

* [Doruntime] fix xpu infer error

* [XPU] update xpu dockerfile

* add xpu triton server docs

* add xpu triton server docs

* add xpu triton server docs

* add xpu triton server docs

* update xpu triton server docs

* update xpu triton server docs

* update xpu triton server docs

* update xpu triton server docs

* update xpu triton server docs

* update xpu triton server docs

* update xpu triton server docs

* update xpu triton server docs

* [XPU] Update XPU L3 Cache setting docs

* [XPU] Add Encryption and AUTH support for XPU Server

* [XPU] Add Encryption and AUTH support for XPU Server

* [Bug Fix] fix paddle reader error

* [Serving] Support XPU encrypt & auth server

* [Serving] Support XPU encrypt & auth server

* [Serving] Support XPU encrypt & auth server

* [Serving] Support XPU encrypt & auth server

* [Triton] switch TAG 22.12 -> TAG 21.10wq

* update xpu auth server script

* [Bug Fix] fix build xpu encrypt & auth image scripts
 2023-07-24 21:00:05 +08:00
DefTruth
ff631b7838 [Server] Support encrypt & auth for FD Server (#2018) 
* [Server] Support GPU encrypt & auth for FD Triton Server

* fix dockerfile proxy env error

* update build scrpits

* remove some logs

---------

Co-authored-by: root <root@yq02-sys-rpm1206692e6.yq02.baidu.com>
Co-authored-by: qiuyanjun <qiuyanjun@baidu.com>
 2023-06-13 20:44:25 +08:00
DefTruth
284b1b46c8 [Serving] Support XPU encrypt & auth server (#2007) 
* [patchelf] fix patchelf error for inference xpu

* [serving] add xpu dockerfile and support fd server

* [serving] add xpu dockerfile and support fd server

* [Serving] support XPU + Tritron

* [Serving] support XPU + Tritron

* [Dockerfile] update xpu tritron docker file -> paddle 0.0.0

* [Dockerfile] update xpu tritron docker file -> paddle 0.0.0

* [Dockerfile] update xpu tritron docker file -> paddle 0.0.0

* [Dockerfile] add comments for xpu tritron dockerfile

* [Doruntime] fix xpu infer error

* [Doruntime] fix xpu infer error

* [XPU] update xpu dockerfile

* add xpu triton server docs

* add xpu triton server docs

* add xpu triton server docs

* add xpu triton server docs

* update xpu triton server docs

* update xpu triton server docs

* update xpu triton server docs

* update xpu triton server docs

* update xpu triton server docs

* update xpu triton server docs

* update xpu triton server docs

* update xpu triton server docs

* [XPU] Update XPU L3 Cache setting docs

* [XPU] Add Encryption and AUTH support for XPU Server

* [XPU] Add Encryption and AUTH support for XPU Server

* [Bug Fix] fix paddle reader error

* [Serving] Support XPU encrypt & auth server

* [Serving] Support XPU encrypt & auth server

* [Serving] Support XPU encrypt & auth server

* [Serving] Support XPU encrypt & auth server

* [Triton] switch TAG 22.12 -> TAG 21.10wq

* update xpu auth server script
 2023-06-01 21:36:44 +08:00
DefTruth
434b48dda5 [Serving] Support FastDeploy XPU Triton Server (#1994) 
* [patchelf] fix patchelf error for inference xpu

* [serving] add xpu dockerfile and support fd server

* [serving] add xpu dockerfile and support fd server

* [Serving] support XPU + Tritron

* [Serving] support XPU + Tritron

* [Dockerfile] update xpu tritron docker file -> paddle 0.0.0

* [Dockerfile] update xpu tritron docker file -> paddle 0.0.0

* [Dockerfile] update xpu tritron docker file -> paddle 0.0.0

* [Dockerfile] add comments for xpu tritron dockerfile

* [Doruntime] fix xpu infer error

* [Doruntime] fix xpu infer error

* [XPU] update xpu dockerfile

* add xpu triton server docs

* add xpu triton server docs

* add xpu triton server docs

* add xpu triton server docs

* update xpu triton server docs

* update xpu triton server docs

* update xpu triton server docs

* update xpu triton server docs

* update xpu triton server docs

* update xpu triton server docs

* update xpu triton server docs

* update xpu triton server docs
 2023-05-29 14:38:25 +08:00
WJJ1995
ee81605e5d [Serving]Support 11.2 CUDA (#1976) 
* add workspace_size option

* support 11.2 cuda

---------

Co-authored-by: DefTruth <31974251+DefTruth@users.noreply.github.com>
 2023-05-23 15:16:07 +08:00
heliqi
3e7cb88049 [Serving]support 22.12 (#1974) 
support 22.12
 2023-05-22 22:27:13 +08:00
DefTruth
f21f2b3dee [cmake] bump up paddle2onnx -> 1.0.7 (#1966) 
* Update paddle2onnx.cmake

* re-run CIs

* [Bug Fix] fix fd+paddle2.4.2 serving build script error
 2023-05-19 16:38:52 +08:00
DefTruth
33e07410da [cmake] Support custom paddle inference url (#1939) 
* [cmake] Support custom paddle inference url

* [Python] Add custom Paddle Inference URL support for python

* [Docker] Add fd serving Dockerfile for paddle2.4.2

* [Docker] Add fd serving Dockerfile for paddle2.4.2

* [Docker] Add fd serving Dockerfile for paddle2.4.2

* [Docker] Add fd serving Dockerfile for paddle2.4.2

* [Bug Fix] fixed result format string error

* rerunning the re-touch CIs

* rerunning CIs
 2023-05-16 14:30:31 +08:00
zhoushunjie
f3daf90f4d Set proxy when compile serving 2023-03-15 13:05:19 +00:00
zhoushunjie
1b1f68499e fix trt version bug 2023-02-22 08:37:25 +00:00
Jack Zhou
1b499f3de2 [Serving] Update serving build script (#1371) 
Update serving build script
 2023-02-20 15:30:49 +08:00
Jack Zhou
ee41944f47 [Serving] Update trt backend to 8.5.2.2 (#1326) 
* update trt backend

* Add trt version args

* Add cuda cudnn version
 2023-02-17 14:05:04 +08:00
chenjian
8c651f9508 [Serving] add fastdeployserver dockerfile for cuda11.2 (#1169) 
* add fastdeployserver dockerfile for cuda11.2

* add docks

* update

---------

Co-authored-by: heliqi <1101791222@qq.com>
 2023-01-30 15:31:20 +08:00
Jason
df20b2a02b [Other] Remove useless macros (#1095) 
* Remove useless macros

* triger ci

* fix check error

* rename INTEGRATE_PADDLE2ONNX to ENABLE_PADDLE2ONNX
 2023-01-09 21:35:23 +08:00
Zeref996
cb7e10277e Fix serving/scripts build.sh (#1053) 
* fix serving/scripts build.sh

* Update build.sh

support:
```
bash build.sh --docker_name=test
```

* Update build.sh

Co-authored-by: heliqi <1101791222@qq.com>
 2023-01-04 17:42:51 +08:00
heliqi
5dca3a45c9 [backend][Serving]Fix paddle backend get outout tensor error (#741) 
fix paddle backend no_copy_infer
 2022-11-29 18:34:56 +08:00
Zeref996
27e68a04e7 fix serving/scripts/build.sh for docker build CI task (#688) 
* fix serving/scripts/build.sh for docker build CI task

* Update build.sh

Co-authored-by: heliqi <1101791222@qq.com>
 2022-11-24 14:32:13 +08:00
Zeref996
521ec87cf5 add http params in serving/scripts/build.sh (#661) 
* add http params in serving/scripts/build.sh

* Update build.sh

Co-authored-by: heliqi <1101791222@qq.com>
 2022-11-22 19:59:39 +08:00
heliqi
2f73857b2b [Serving]Update images version to 0.6.0 (#594) 
* serving images update to 0.6

* serving images update to 0.6

* serving images update to 0.6
 2022-11-16 10:11:43 +08:00
heliqi
2693434190 [Serving]optimize serving build script (#569) 
* optimizer serving build

* optimizer serving build

* optimizer serving build
 2022-11-12 14:01:50 +08:00
czr-gc
da84da7448 [Serving]: add ipu support for serving. (#10) (#470) 
* feat(ipu): add ipu docker for serving. (#10)

* feat(ipu): add ipu docker for serving.

* feat(ipu): enable ipu docker in serving.

* fix(): fix typo and issues in IPU.

* remove unused env path.

* doc(ipu): add ipu docker build doc and fix typo.

* fix(): clean apt cache in docker.

* fix(ipu): fix typo.
 2022-11-02 09:50:58 +08:00
heliqi
c30df2021f [Serving]cpu images fix python core (#401) 
serving cpu fix python core
 2022-10-20 11:55:15 +08:00
heliqi
831ef42207 fix paddle-mkldnn bug (#366) 
* fix input name bug

* fix paddle-mkldnn bug
 2022-10-13 21:37:31 +08:00
heliqi
8a3ad3eb43 fix input name bug (#352) 2022-10-13 11:49:27 +08:00
heliqi
5328fbc861 support build cpu images (#341) 2022-10-11 14:17:27 +08:00
heliqi
d57e997fa0 Fd serving add docker images correlation and docs (#311) 
* fd serving add dockerfile

* fix enable_paddle_mkldnn

* delete disable_paddle_mkldnn

Co-authored-by: Jason <jiangjiajun@baidu.com>
 2022-10-08 16:08:07 +08:00