Files
FastDeploy/docs/en/build_and_install
Wang Xinyu caa369f64a [Backend] TRT cast GPU input from int64 to int32, output from int32 to int64, and Windows support building CUDA files (#426)
* TRT cast int64 to int32

* windows cmake build cuda src

* fix windows cmake error when build cuda src

* add a notice in windows gpu build doc

* cmake add cuda std=11

* TRT cast output from int32 to int64

* nits

* trt get original input output dtype
2022-10-28 13:38:06 +08:00
..
2022-10-15 22:01:27 +08:00
2022-10-15 22:01:27 +08:00
2022-10-15 22:01:27 +08:00
2022-10-19 10:58:31 +08:00

Install FastDeploy - Tutorials

Build options

option description
ENABLE_ORT_BACKEND Default OFF, whether to enable ONNX Runtime backend(CPU/GPU)
ENABLE_PADDLE_BACKEND Default OFFwhether to enable Paddle Inference backend(CPU/GPU)
ENABLE_TRT_BACKEND Default OFFwhether to enable TensorRT backend(GPU)
ENABLE_OPENVINO_BACKEND Default OFFwhether to enable OpenVINO backend(CPU)
ENABLE_VISION Default OFFwhether to enable vision models deployment module
ENABLE_TEXT Default OFFwhether to enable text models deployment module
WITH_GPU Default OFF, if build on GPU, this need to be ON
CUDA_DIRECTORY Default /usr/local/cuda, if build on GPU, this defines the path of CUDA(>=11.2)
TRT_DIRECTORY If build with ENABLE_TRT_BACKEND=ON, this defines the path of TensorRT(>=8.4)
ORT_DIRECTORY [Optional] If build with ENABLE_ORT_BACKEND=ON, this flag defines the path of ONNX Runtime, but if this flag is not set, it will download ONNX Runtime library automatically
OPENCV_DIRECTORY [Optional] If build with ENABLE_VISION=ON, this flag defines the path of OpenCV, but if this flag is not set, it will download OpenCV library automatically
OPENVINO_DIRECTORY [Optional] If build WITH ENABLE_OPENVINO_BACKEND=ON, this flag defines the path of OpenVINO, but if this flag is not set, it will download OpenVINO library automatically