Files
FastDeploy/docs/en/build_and_install
WJJ1995 581962bcbb [Doc] Update download_prebuilt_libraries.md (#541)
* add paddle_trt in benchmark

* update benchmark in device

* update benchmark

* update result doc

* fixed for CI

* update python api_docs

* update index.rst

* add runtime cpp examples

* deal with comments

* Update infer_paddle_tensorrt.py

* Add runtime quick start

* deal with comments

* fixed reused_input_tensors&&reused_output_tensors

* fixed docs

Co-authored-by: Jason <928090362@qq.com>
2022-11-09 14:38:50 +08:00
..
2022-10-15 22:01:27 +08:00
2022-10-15 22:01:27 +08:00
2022-10-15 22:01:27 +08:00
2022-10-19 10:58:31 +08:00

Install FastDeploy - Tutorials

Build options

option description
ENABLE_ORT_BACKEND Default OFF, whether to enable ONNX Runtime backend(CPU/GPU)
ENABLE_PADDLE_BACKEND Default OFFwhether to enable Paddle Inference backend(CPU/GPU)
ENABLE_TRT_BACKEND Default OFFwhether to enable TensorRT backend(GPU)
ENABLE_OPENVINO_BACKEND Default OFFwhether to enable OpenVINO backend(CPU)
ENABLE_VISION Default OFFwhether to enable vision models deployment module
ENABLE_TEXT Default OFFwhether to enable text models deployment module
WITH_GPU Default OFF, if build on GPU, this need to be ON
CUDA_DIRECTORY Default /usr/local/cuda, if build on GPU, this defines the path of CUDA(>=11.2)
TRT_DIRECTORY If build with ENABLE_TRT_BACKEND=ON, this defines the path of TensorRT(>=8.4)
ORT_DIRECTORY [Optional] If build with ENABLE_ORT_BACKEND=ON, this flag defines the path of ONNX Runtime, but if this flag is not set, it will download ONNX Runtime library automatically
OPENCV_DIRECTORY [Optional] If build with ENABLE_VISION=ON, this flag defines the path of OpenCV, but if this flag is not set, it will download OpenCV library automatically
OPENVINO_DIRECTORY [Optional] If build WITH ENABLE_OPENVINO_BACKEND=ON, this flag defines the path of OpenVINO, but if this flag is not set, it will download OpenVINO library automatically