Commit Graph

9 Commits

Author SHA1 Message Date
DefTruth
434b48dda5 [Serving] Support FastDeploy XPU Triton Server (#1994)
* [patchelf] fix patchelf error for inference xpu

* [serving] add xpu dockerfile and support fd server

* [serving] add xpu dockerfile and support fd server

* [Serving] support XPU + Tritron

* [Serving] support XPU + Tritron

* [Dockerfile] update xpu tritron docker file -> paddle 0.0.0

* [Dockerfile] update xpu tritron docker file -> paddle 0.0.0

* [Dockerfile] update xpu tritron docker file -> paddle 0.0.0

* [Dockerfile] add comments for xpu tritron dockerfile

* [Doruntime] fix xpu infer error

* [Doruntime] fix xpu infer error

* [XPU] update xpu dockerfile

* add xpu triton server docs

* add xpu triton server docs

* add xpu triton server docs

* add xpu triton server docs

* update xpu triton server docs

* update xpu triton server docs

* update xpu triton server docs

* update xpu triton server docs

* update xpu triton server docs

* update xpu triton server docs

* update xpu triton server docs

* update xpu triton server docs
2023-05-29 14:38:25 +08:00
DefTruth
652024d2f6 Revert "Remove Paddle Reader" (#1860)
Revert "Remove Paddle Reader (#1813)"

This reverts commit f3d44785c4.
2023-04-23 23:16:31 +08:00
Jason
f3d44785c4 Remove Paddle Reader (#1813)
* Remove Paddle Reader

* support pp-infer c++14

* disable trt cache

---------

Co-authored-by: wang-xinyu <wangxinyu_es@163.com>
2023-04-20 21:12:43 +08:00
Jack Zhou
f7ef464412 [Other] Use symbolic link pointed to TensorRT library (#1461)
* Add force rpath

* update to dev-6

* remove force-rpath

* remove nvinfer so

* Add symbol link creation when import fastdeploy first

* Add dst

* update symbol link creation

* Add logging

* logging -> logger

* update tips

* Set logging level

* Add --force-rpath
2023-03-10 09:09:04 +08:00
Jack Zhou
dccb737d8d [Backend] Add collect shape for pp-trt backend (#372)
* Add collect_shape attr

* add EnableTunedTensorRtDynamicShape

* Add collect shape python api

* Fix quant model not set trt dynamic shape

* Add shape info print

* Fix shape print

* Use CopyFromCpu instead of ShareExternalData

* Add ENABLE_TRT_BACKEND macro

* Add shared data with
2022-10-20 17:02:56 +08:00
PaddleCI
cc7220d321 fix compile on mac 2022-09-29 10:38:32 +08:00
Jason
311a59c62d Add patchelf to solve the build problem on Linux without patchelf (#291)
* add patchelf as tool

* Update CMakeLists.txt
2022-09-28 10:48:49 +08:00
Jason
36eb6fbba6 Fix build on jetson (#281)
* Fix compile on Jetson

* trigger ci
2022-09-26 19:23:30 +08:00
Jason
5046574b95 Fix bug for part of detection model (#243)
* fix error for part of detection model

* fix error for part of detection model

* add patch paddle inference
2022-09-16 16:31:34 +08:00