apps/FastDeploy
1
0
Fork 0
mirror of https://github.com/PaddlePaddle/FastDeploy.git synced 2025-12-24 13:28:13 +08:00
Code Issues Actions 2 Packages Projects Releases Wiki Activity
2,449 Commits 29 Branches 10 Tags
577b7a7681801099e9eebfdf57f4b4ff5199e950
Commit Graph

79 Commits

Author SHA1 Message Date
ChaoII
df7758d400 [DOC]fix doc dead link 2024-03-29 09:29:09 +08:00
heliqi
d197f7d7d4 update serving images (#2387) 
Co-authored-by: root <root@bjyz-sys-gpu-kongming2.bjyz.baidu.com>
 2024-03-01 11:02:28 +08:00
DefTruth
12bb44e0de [Bug Fix] fix build xpu encrypt & auth image scripts (#2133) 
* [patchelf] fix patchelf error for inference xpu

* [serving] add xpu dockerfile and support fd server

* [serving] add xpu dockerfile and support fd server

* [Serving] support XPU + Tritron

* [Serving] support XPU + Tritron

* [Dockerfile] update xpu tritron docker file -> paddle 0.0.0

* [Dockerfile] update xpu tritron docker file -> paddle 0.0.0

* [Dockerfile] update xpu tritron docker file -> paddle 0.0.0

* [Dockerfile] add comments for xpu tritron dockerfile

* [Doruntime] fix xpu infer error

* [Doruntime] fix xpu infer error

* [XPU] update xpu dockerfile

* add xpu triton server docs

* add xpu triton server docs

* add xpu triton server docs

* add xpu triton server docs

* update xpu triton server docs

* update xpu triton server docs

* update xpu triton server docs

* update xpu triton server docs

* update xpu triton server docs

* update xpu triton server docs

* update xpu triton server docs

* update xpu triton server docs

* [XPU] Update XPU L3 Cache setting docs

* [XPU] Add Encryption and AUTH support for XPU Server

* [XPU] Add Encryption and AUTH support for XPU Server

* [Bug Fix] fix paddle reader error

* [Serving] Support XPU encrypt & auth server

* [Serving] Support XPU encrypt & auth server

* [Serving] Support XPU encrypt & auth server

* [Serving] Support XPU encrypt & auth server

* [Triton] switch TAG 22.12 -> TAG 21.10wq

* update xpu auth server script

* [Bug Fix] fix build xpu encrypt & auth image scripts
 2023-07-24 21:00:05 +08:00
yeliang2258
ad1f46f7d9 Add ORT fp16 support in server (#2069) 
* add ort fp16 support in server

* update paddle2onnx url

* update ort fp16 api

* add disable_ort_fp16_op_types in serving
 2023-07-05 17:50:00 +08:00
DefTruth
5b8a3b498d [Bug Fix] fixed fd server use_paddle parameter parse policy (#2044) 
* [Server] Support GPU encrypt & auth for FD Triton Server

* fix dockerfile proxy env error

* update build scrpits

* remove some logs

* [Bug Fix] fixed fd server use_paddle parameter parse policy

* optimize paddle-trt policy

* optimize paddle-trt policy

---------

Co-authored-by: root <root@yq02-sys-rpm1206692e6.yq02.baidu.com>
Co-authored-by: qiuyanjun <qiuyanjun@baidu.com>
 2023-06-21 15:44:32 +08:00
DefTruth
ff631b7838 [Server] Support encrypt & auth for FD Server (#2018) 
* [Server] Support GPU encrypt & auth for FD Triton Server

* fix dockerfile proxy env error

* update build scrpits

* remove some logs

---------

Co-authored-by: root <root@yq02-sys-rpm1206692e6.yq02.baidu.com>
Co-authored-by: qiuyanjun <qiuyanjun@baidu.com>
 2023-06-13 20:44:25 +08:00
DefTruth
284b1b46c8 [Serving] Support XPU encrypt & auth server (#2007) 
* [patchelf] fix patchelf error for inference xpu

* [serving] add xpu dockerfile and support fd server

* [serving] add xpu dockerfile and support fd server

* [Serving] support XPU + Tritron

* [Serving] support XPU + Tritron

* [Dockerfile] update xpu tritron docker file -> paddle 0.0.0

* [Dockerfile] update xpu tritron docker file -> paddle 0.0.0

* [Dockerfile] update xpu tritron docker file -> paddle 0.0.0

* [Dockerfile] add comments for xpu tritron dockerfile

* [Doruntime] fix xpu infer error

* [Doruntime] fix xpu infer error

* [XPU] update xpu dockerfile

* add xpu triton server docs

* add xpu triton server docs

* add xpu triton server docs

* add xpu triton server docs

* update xpu triton server docs

* update xpu triton server docs

* update xpu triton server docs

* update xpu triton server docs

* update xpu triton server docs

* update xpu triton server docs

* update xpu triton server docs

* update xpu triton server docs

* [XPU] Update XPU L3 Cache setting docs

* [XPU] Add Encryption and AUTH support for XPU Server

* [XPU] Add Encryption and AUTH support for XPU Server

* [Bug Fix] fix paddle reader error

* [Serving] Support XPU encrypt & auth server

* [Serving] Support XPU encrypt & auth server

* [Serving] Support XPU encrypt & auth server

* [Serving] Support XPU encrypt & auth server

* [Triton] switch TAG 22.12 -> TAG 21.10wq

* update xpu auth server script
 2023-06-01 21:36:44 +08:00
DefTruth
387c5695b3 [XPU] Update XPU L3 Cache setting docs (#2001) 
* [patchelf] fix patchelf error for inference xpu

* [serving] add xpu dockerfile and support fd server

* [serving] add xpu dockerfile and support fd server

* [Serving] support XPU + Tritron

* [Serving] support XPU + Tritron

* [Dockerfile] update xpu tritron docker file -> paddle 0.0.0

* [Dockerfile] update xpu tritron docker file -> paddle 0.0.0

* [Dockerfile] update xpu tritron docker file -> paddle 0.0.0

* [Dockerfile] add comments for xpu tritron dockerfile

* [Doruntime] fix xpu infer error

* [Doruntime] fix xpu infer error

* [XPU] update xpu dockerfile

* add xpu triton server docs

* add xpu triton server docs

* add xpu triton server docs

* add xpu triton server docs

* update xpu triton server docs

* update xpu triton server docs

* update xpu triton server docs

* update xpu triton server docs

* update xpu triton server docs

* update xpu triton server docs

* update xpu triton server docs

* update xpu triton server docs

* [XPU] Update XPU L3 Cache setting docs
 2023-05-30 11:21:04 +08:00
DefTruth
434b48dda5 [Serving] Support FastDeploy XPU Triton Server (#1994) 
* [patchelf] fix patchelf error for inference xpu

* [serving] add xpu dockerfile and support fd server

* [serving] add xpu dockerfile and support fd server

* [Serving] support XPU + Tritron

* [Serving] support XPU + Tritron

* [Dockerfile] update xpu tritron docker file -> paddle 0.0.0

* [Dockerfile] update xpu tritron docker file -> paddle 0.0.0

* [Dockerfile] update xpu tritron docker file -> paddle 0.0.0

* [Dockerfile] add comments for xpu tritron dockerfile

* [Doruntime] fix xpu infer error

* [Doruntime] fix xpu infer error

* [XPU] update xpu dockerfile

* add xpu triton server docs

* add xpu triton server docs

* add xpu triton server docs

* add xpu triton server docs

* update xpu triton server docs

* update xpu triton server docs

* update xpu triton server docs

* update xpu triton server docs

* update xpu triton server docs

* update xpu triton server docs

* update xpu triton server docs

* update xpu triton server docs
 2023-05-29 14:38:25 +08:00
WJJ1995
9a5b291f60 [Serving]Fixed dockerfile (#1978) 
* add workspace_size option

* support 11.2 cuda

* fixed dockerfile

---------

Co-authored-by: DefTruth <31974251+DefTruth@users.noreply.github.com>
 2023-05-23 16:22:53 +08:00
WJJ1995
ee81605e5d [Serving]Support 11.2 CUDA (#1976) 
* add workspace_size option

* support 11.2 cuda

---------

Co-authored-by: DefTruth <31974251+DefTruth@users.noreply.github.com>
 2023-05-23 15:16:07 +08:00
heliqi
3e7cb88049 [Serving]support 22.12 (#1974) 
support 22.12
 2023-05-22 22:27:13 +08:00
DefTruth
f21f2b3dee [cmake] bump up paddle2onnx -> 1.0.7 (#1966) 
* Update paddle2onnx.cmake

* re-run CIs

* [Bug Fix] fix fd+paddle2.4.2 serving build script error
 2023-05-19 16:38:52 +08:00
WJJ1995
92fcee6c3b [Serving] Add trt workspace_size option for serving (#1963) 
add workspace_size option

Co-authored-by: DefTruth <31974251+DefTruth@users.noreply.github.com>
 2023-05-19 11:29:58 +08:00
DefTruth
33e07410da [cmake] Support custom paddle inference url (#1939) 
* [cmake] Support custom paddle inference url

* [Python] Add custom Paddle Inference URL support for python

* [Docker] Add fd serving Dockerfile for paddle2.4.2

* [Docker] Add fd serving Dockerfile for paddle2.4.2

* [Docker] Add fd serving Dockerfile for paddle2.4.2

* [Docker] Add fd serving Dockerfile for paddle2.4.2

* [Bug Fix] fixed result format string error

* rerunning the re-touch CIs

* rerunning CIs
 2023-05-16 14:30:31 +08:00
DefTruth
652024d2f6 Revert "Remove Paddle Reader" (#1860) 
Revert "Remove Paddle Reader (#1813)"

This reverts commit f3d44785c4.
 2023-04-23 23:16:31 +08:00
Jason
f3d44785c4 Remove Paddle Reader (#1813) 
* Remove Paddle Reader

* support pp-infer c++14

* disable trt cache

---------

Co-authored-by: wang-xinyu <wangxinyu_es@163.com>
 2023-04-20 21:12:43 +08:00
Zeref996
33bc32d667 refresh version number 1.0.6 2023-04-20 10:54:56 +08:00
Zeref996
b00cb4223d refresh doc version 1.0.5 2023-03-29 11:05:10 +08:00
Zeref996
b8f8f09e37 fix dockerfile paddle install url 2023-03-21 10:47:06 +08:00
Jack Zhou
012c7771c1 [Serving] Add collect shape and fix serving infer (#1658) 
Add collect shape and fix serving infer
 2023-03-20 19:55:30 +08:00
zhoushunjie
f3daf90f4d Set proxy when compile serving 2023-03-15 13:05:19 +00:00
zhoushunjie
cd9cb577fe disable_trt_ops->delete_passes 2023-03-09 06:14:53 +00:00
zhoushunjie
90942a7ada DisablePaddleTrtOP->DisableTrtOps 2023-03-09 06:01:48 +00:00
zhoushunjie
f88b06a4ff Add delete pass, disable_trt_ops and enable_fixed_size_opt for serving 2023-03-09 03:18:22 +00:00
Jason
ae254c60f4 Update README_CN.md 2023-02-27 21:36:12 +08:00
Jason
a154644b21 Update README.md 2023-02-27 21:34:54 +08:00
Jason
763af6aa8e Update README.md 2023-02-27 21:33:51 +08:00
Wang Xinyu
017f305632 [Serving] Compile on CentOS without docker tutorial (#1440) 
serving compile doc
 2023-02-27 11:02:39 +08:00
Zeref996
be313a859b fix serving/Dockerfile (#1397) 
* fix serving/Dockerfile

* fix download paddlepaddle
 2023-02-27 10:32:28 +08:00
heliqi
fc37b8dd49 [Serving]Update compile.md (#1433) 
* Update compile.md

* Update compile-en.md
 2023-02-27 09:42:03 +08:00
Zeref996
a1f9aa1c5a refresh docker compile doc (#1423) 
* refresh docker compile doc

* refresh docker compile doc 1
 2023-02-23 14:59:50 +08:00
zhoushunjie
1b1f68499e fix trt version bug 2023-02-22 08:37:25 +00:00
Jack Zhou
1b499f3de2 [Serving] Update serving build script (#1371) 
Update serving build script
 2023-02-20 15:30:49 +08:00
heliqi
8f21d55e5c [Serving]support encryt (#1349) 
* serving support encryt

* Update fastdeploy_runtime.cc
 2023-02-17 15:29:57 +08:00
Jack Zhou
ee41944f47 [Serving] Update trt backend to 8.5.2.2 (#1326) 
* update trt backend

* Add trt version args

* Add cuda cudnn version
 2023-02-17 14:05:04 +08:00
Jason
713afe7f1c [Other] Deprecate some option api and parameters (#1243) 
* Optimize Poros backend

* fix error

* Add more pybind

* fix conflicts

* add some deprecate notices

* [Other] Deprecate some apis in RuntimeOption (#1240)

* Deprecate more options

* modify serving

* Update option.h

* fix tensorrt error

* Update option_pybind.cc

* Update option_pybind.cc

* Fix error in serving

* fix word spell error
 2023-02-07 17:57:46 +08:00
Zeref996
2f0b509004 refresh doc version release 1.0.3 (#1216) 2023-02-01 19:48:19 +08:00
Zeref996
1f1dfc6c75 fix serving/Dockerfile, unset http_proxy (#1199) 
* fix serving/Dockerfile, unset http_proxy

* fix serving/Dockerfile 1, unset http_proxy
 2023-01-31 17:49:53 +08:00
chenjian
595ca69251 [Doc] Add doc for vdl serving (#1110) 
* add doc for vdl serving

* add doc for vdl serving

* add doc for vdl serving

* fix link

* fix link

* fix gif size

* fix gif size

* add english version

* fix links

* fix links

* update format

* update docs

* update docs

* update docs

* update docs

* update docs

* update docs

---------

Co-authored-by: heliqi <1101791222@qq.com>
 2023-01-30 19:22:59 +08:00
chenjian
8c651f9508 [Serving] add fastdeployserver dockerfile for cuda11.2 (#1169) 
* add fastdeployserver dockerfile for cuda11.2

* add docks

* update

---------

Co-authored-by: heliqi <1101791222@qq.com>
 2023-01-30 15:31:20 +08:00
Jason
df20b2a02b [Other] Remove useless macros (#1095) 
* Remove useless macros

* triger ci

* fix check error

* rename INTEGRATE_PADDLE2ONNX to ENABLE_PADDLE2ONNX
 2023-01-09 21:35:23 +08:00
HCQ14
61c2f87e0c [Doc] Update English version of some documents (#1084) 
* Create README_CN.md

* Update README.md

* Update README_CN.md

* Create README_CN.md

* Update README.md

* Create README_CN.md

* Update README.md

* Create README_CN.md

* Update README.md

* Create README_CN.md

* Update README.md

* Create README_CN.md

* Update README.md

* Create README_CN.md

* Update README.md

* Create README_CN.md

* Update README.md

* Update README.md

* Update README_CN.md

* Create README_CN.md

* Update README.md

* Update README.md

* Update and rename README_en.md to README_CN.md

* Update WebDemo.md

* Update and rename WebDemo_en.md to WebDemo_CN.md

* Update and rename DEVELOPMENT_cn.md to DEVELOPMENT_CN.md

* Update DEVELOPMENT_CN.md

* Update DEVELOPMENT.md

* Update RNN.md

* Update and rename RNN_EN.md to RNN_CN.md

* Update README.md

* Update and rename README_en.md to README_CN.md

* Update README.md

* Update and rename README_en.md to README_CN.md

* Update README.md

* Update README_cn.md

* Rename README_cn.md to README_CN.md

* Update README.md

* Update README_cn.md

* Rename README_cn.md to README_CN.md

* Update export.md

* Update and rename export_EN.md to export_CN.md

* Update README.md

* Update README.md

* Create README_CN.md

* Update README.md

* Update README.md

* Update kunlunxin.md

* Update classification_result.md

* Update classification_result_EN.md

* Rename classification_result_EN.md to classification_result_CN.md

* Update detection_result.md

* Update and rename detection_result_EN.md to detection_result_CN.md

* Update face_alignment_result.md

* Update and rename face_alignment_result_EN.md to face_alignment_result_CN.md

* Update face_detection_result.md

* Update and rename face_detection_result_EN.md to face_detection_result_CN.md

* Update face_recognition_result.md

* Update and rename face_recognition_result_EN.md to face_recognition_result_CN.md

* Update headpose_result.md

* Update and rename headpose_result_EN.md to headpose_result_CN.md

* Update keypointdetection_result.md

* Update and rename keypointdetection_result_EN.md to keypointdetection_result_CN.md

* Update matting_result.md

* Update and rename matting_result_EN.md to matting_result_CN.md

* Update mot_result.md

* Update and rename mot_result_EN.md to mot_result_CN.md

* Update ocr_result.md

* Update and rename ocr_result_EN.md to ocr_result_CN.md

* Update segmentation_result.md

* Update and rename segmentation_result_EN.md to segmentation_result_CN.md

* Update README.md

* Update README.md

* Update quantize.md

* Update README.md

* Update README.md

* Update README.md

* Update README.md

* Update README.md

* Update README.md

* Update README.md
 2023-01-06 18:01:34 +08:00
Zeref996
5ea3cb0fd8 fix serving/Dockerfile (#1082) 2023-01-06 16:38:17 +08:00
Zeref996
edc18c9fc8 fix serving/Dockerfile http_proxy (#1066) 
fix serving/Dockerfile
 2023-01-05 13:39:40 +08:00
Zeref996
cb7e10277e Fix serving/scripts build.sh (#1053) 
* fix serving/scripts build.sh

* Update build.sh

support:
```
bash build.sh --docker_name=test
```

* Update build.sh

Co-authored-by: heliqi <1101791222@qq.com>
 2023-01-04 17:42:51 +08:00
heliqi
97a0a9e33f [Serving]Update Dockerfile (#1049) 
Update Dockerfile
 2023-01-04 14:48:29 +08:00
charl-u
f72846c717 [Doc]Revise one wording (#1028) 
* 第一次提交

* 补充一处漏翻译

* deleted:    docs/en/quantize.md

* Update one translation

* Update en version

* Update one translation in code

* Standardize one writing

* Standardize one writing

* Update some en version

* Fix a grammer problem

* Update en version for api/vision result

* Merge branch 'develop' of https://github.com/charl-u/FastDeploy into develop

* Checkout the link in README in vision_results/ to the en documents

* Modify a title

* Add link to serving/docs/

* Finish translation of demo.md

* Update english version of serving/docs/

* Update title of readme

* Update some links

* Modify a title

* Update some links

* Update en version of java android README

* Modify some titles

* Modify some titles

* Modify some titles

* modify article to document
 2023-01-03 10:01:10 +08:00
Zeref996
971cc051f4 fresh doc version release/1.0.2 (#1023) 
fresh doc version
 2023-01-03 09:37:53 +08:00
heliqi
0ead9d27c2 [Serving]modify docker images name (#992) 
* modify docker images name

* Update Dockerfile_cpu
 2022-12-27 21:29:27 +08:00