8.5 KiB
English | 中文
How to Install Prebuilt Library
FastDeploy provides pre-built libraries for developers to download and install directly. Meanwhile, FastDeploy also offers easy access to compile so that developers can compile FastDeploy according to their own needs.
This document is divided into two parts:
GPU Deployment Environment
Environment Requirement
- CUDA >= 11.2
- cuDNN >= 8.0
- python >= 3.6
- OS: Linux(x64)/Windows 10(x64)
FastDeploy supports Computer Vision, Text and NLP model deployment on CPU and Nvidia GPU with Paddle Inference, ONNX Runtime, OpenVINO and TensorRT inference backends.
version information: Paddle Inference==2.4-dev5, ONNXRuntime==1.12.0, OpenVINO==2022.2.0.dev20220829, TensorRT==8.5.2.2
Python SDK
Install the released version（the newest 1.0.4 for now）
pip install fastdeploy-gpu-python -f https://www.paddlepaddle.org.cn/whl/fastdeploy.html
Install the Develop version（Nightly build）
pip install fastdeploy-gpu-python==0.0.0 -f https://www.paddlepaddle.org.cn/whl/fastdeploy_nightly_build.html
We recommend users to use Conda to configure the development environment.
conda config --add channels conda-forge && conda install cudatoolkit=11.2 cudnn=8.2
C++ SDK
Install the released version（Latest 1.0.4）
| Platform | File | Description |
|---|---|---|
| Linux x64 | fastdeploy-linux-x64-gpu-1.0.4.tgz | g++ 8.2, CUDA 11.2, cuDNN 8.2 |
| Windows x64 | fastdeploy-win-x64-gpu-1.0.4.zip | Visual Studio 16 2019, CUDA 11.2, cuDNN 8.2 |
Install the Develop version（Nightly build）
| Platform | File | Description |
|---|---|---|
| Linux x64 | fastdeploy-linux-x64-gpu-0.0.0.tgz | g++ 8.2, CUDA 11.2, cuDNN 8.2 |
| Windows x64 | fastdeploy-win-x64-gpu-0.0.0.zip | Visual Studio 16 2019, CUDA 11.2, cuDNN 8.2 |
CPU Deployment Environment
Environment Requirement
- python >= 3.6
- OS: Linux(x64/aarch64)/Windows 10 x64/Mac OSX(x86/aarm64)
FastDeploy supports computer vision, text and NLP model deployment on CPU with Paddle Inference, ONNX Runtime, OpenVINO inference backends. It should be noted that under Linux aarch64 and Mac OSX, only the ONNX Runtime is supported for now.
version information: Paddle Inference==2.4-dev5, ONNXRuntime==1.12.0, OpenVINO==2022.2.0.dev20220829
Python SDK
Install the released version（Latest 1.0.4 for now）
pip install fastdeploy-python -f https://www.paddlepaddle.org.cn/whl/fastdeploy.html
Install the Develop version（Nightly build）
pip install fastdeploy-python==0.0.0 -f https://www.paddlepaddle.org.cn/whl/fastdeploy_nightly_build.html
C++ SDK
Install the released version（Latest 1.0.4 for now, Android is 1.0.4）
| Platform | File | Description |
|---|---|---|
| Linux x64 | fastdeploy-linux-x64-1.0.4.tgz | g++ 8.2 |
| Windows x64 | fastdeploy-win-x64-1.0.4.zip | Visual Studio 16 2019 |
| Mac OSX x64 | fastdeploy-osx-x86_64-1.0.4.tgz | clang++ 10.0.0 |
| Mac OSX arm64 | fastdeploy-osx-arm64-1.0.4.tgz | clang++ 13.0.0 |
| Linux aarch64 | fastdeploy-linux-aarch64-1.0.4.tgz | gcc 6.3 |
| Android armv7&v8 | fastdeploy-android-1.0.4-shared.tgz | CV API, NDK 25, clang++, support arm64-v8a and armeabi-v7a |
| Android armv7&v8 | fastdeploy-android-with-text-1.0.4-shared.tgz | contains Text API, such as FastTokenizer and UIE, CV API, NDK 25, clang++, support arm64-v8a and armeabi-v7a |
| Android armv7&v8 | fastdeploy-android-with-text-only-1.0.4-shared.tgz | only contains Text API, such as FastTokenizer and UIE, NDK 25, clang++, does not contain CV API, support arm64-v8a and armeabi-v7a |
Java SDK
Install the released version（Android is 1.0.4 pre-release）
| Platform | File | Description |
|---|---|---|
| Android Java SDK | fastdeploy-android-sdk-1.0.4.aar | CV API, NDK 20, minSdkVersion 15, targetSdkVersion 28 |
| Android Java SDK | fastdeploy-android-sdk-with-text-1.0.4.aar | contains Text API, such as FastTokenizer and UIE, CV API, NDK 20, minSdkVersion 15, targetSdkVersion 28 |
Install the Develop version（Nightly build）
| Platform | File | Description |
|---|---|---|
| Linux x64 | fastdeploy-linux-x64-0.0.0.tgz | g++ 8.2 |
| Windows x64 | fastdeploy-win-x64-0.0.0.zip | Visual Studio 16 2019 |
| Mac OSX x64 | fastdeploy-osx-arm64-0.0.0.tgz | - |
| Mac OSX arm64 | fastdeploy-osx-arm64-0.0.0.tgz | clang++ 13.0.0 to compile |
| Linux aarch64 | fastdeploy-linux-aarch64-0.0.0.tgz | - |
| Android armv7&v8 | fastdeploy-android-0.0.0-shared.tgz | CV API, NDK 25, clang++, support arm64-v8a and armeabi-v7a |
| Android armv7&v8 | fastdeploy-android-with-text-0.0.0-shared.tgz | contains Text API, such as FastTokenizer and UIE, CV API, such as OpenCV, NDK 25, clang++, support arm64-v8a and armeabi-v7a |
| Android armv7&v8 | fastdeploy-android-with-text-only-0.0.0-shared.tgz | only contains Text API, such as FastTokenizer and UIE，NDK 25, clang++, does not contain CV API, support arm64-v8a and armeabi-v7a |
| Android Java SDK | fastdeploy-android-sdk-0.0.0.aar | CV API, NDK 20, minSdkVersion 15, targetSdkVersion 28 |
| Android Java SDK | fastdeploy-android-sdk-with-text-0.0.0.aar | contains Text API, such as FastTokenizer and UIE, CV API, such as OpenCV, NDK 20, minSdkVersion 15, targetSdkVersion 28 |