FastDeploy/fastdeploy

FastDeploy C++ API Summary

Runtime

FastDeploy Runtime can be used as an inference engine with the same code, we can deploy Paddle/ONNX model on different device by different backends.
Currently, FastDeploy supported backends listed as below,

Backend	Hardware	Support Model Format	Platform
Paddle Inference	CPU/Nvidia GPU	Paddle	Windows(x64)/Linux(x64)
ONNX Runtime	CPU/Nvidia GPU	Paddle/ONNX	Windows(x64)/Linux(x64/aarch64)/Mac(x86/arm64)
TensorRT	Nvidia GPU	Paddle/ONNX	Windows(x64)/Linux(x64)/Jetson
OpenVINO	CPU	Paddle/ONNX	Windows(x64)/Linux(x64)/Mac(x86)

Example code

• Python examples
• C++ examples

Related APIs

• RuntimeOption
• Runtime

Vision Models

Task	Model	API	Example
object detection	PaddleDetection/PPYOLOE	fastdeploy::vision::detection::PPYOLOE	C++/Python