Commit Graph

59 Commits

Author SHA1 Message Date
czr-gc
da84da7448 [Serving]: add ipu support for serving. (#10) (#470)
* feat(ipu): add ipu docker for serving. (#10)

* feat(ipu): add ipu docker for serving.

* feat(ipu): enable ipu docker in serving.

* fix(): fix typo and issues in IPU.

* remove unused env path.

* doc(ipu): add ipu docker build doc and fix typo.

* fix(): clean apt cache in docker.

* fix(ipu): fix typo.
2022-11-02 09:50:58 +08:00
heliqi
b064ddf7ed [Serving][backend]serving support multi stream and backend support external stream (#431)
* serving support multi stream

* pybind add external stream

Co-authored-by: Jason <jiangjiajun@baidu.com>
2022-10-26 14:46:13 +08:00
heliqi
587ffd4caf [Serving]add ernie-3.0 demo (#399)
serving add ernie-3.0 demo
2022-10-20 15:29:47 +08:00
heliqi
c30df2021f [Serving]cpu images fix python core (#401)
serving cpu fix python core
2022-10-20 11:55:15 +08:00
heliqi
831ef42207 fix paddle-mkldnn bug (#366)
* fix input name bug

* fix paddle-mkldnn bug
2022-10-13 21:37:31 +08:00
heliqi
8a3ad3eb43 fix input name bug (#352) 2022-10-13 11:49:27 +08:00
heliqi
5328fbc861 support build cpu images (#341) 2022-10-11 14:17:27 +08:00
heliqi
d57e997fa0 Fd serving add docker images correlation and docs (#311)
* fd serving add dockerfile

* fix enable_paddle_mkldnn

* delete disable_paddle_mkldnn

Co-authored-by: Jason <jiangjiajun@baidu.com>
2022-10-08 16:08:07 +08:00
heliqi
69be5b5232 fastdeploy support serving (#272)
* fd support serving

* fd support serving optimize dir

* optimize code

Co-authored-by: Jason <jiangjiajun@baidu.com>
2022-09-27 14:07:19 +08:00