apps/FastDeploy
1
0
Fork 0
mirror of https://github.com/PaddlePaddle/FastDeploy.git synced 2025-10-16 05:30:58 +08:00
Code Issues Actions 6 Packages Projects Releases Wiki Activity
Files
0692dcc4057413fe15da9c664d1faac263eae0b5
FastDeploy/fastdeploy/README.md
Jason 12e5a65fc3 Add some comments for ppyoloe (#324) 
* Add some comments for ppyoloe

* Update runtime.h
2022-10-07 20:41:04 +08:00

1.1 KiB
Raw Blame History

FastDeploy C++ API Summary

Runtime

FastDeploy Runtime can be used as an inference engine with the same code, we can deploy Paddle/ONNX model on different device by different backends.
Currently, FastDeploy supported backends listed as below,

Backend Hardware Support Model Format Platform
Paddle Inference CPU/Nvidia GPU Paddle Windows(x64)/Linux(x64)
ONNX Runtime CPU/Nvidia GPU Paddle/ONNX Windows(x64)/Linux(x64/aarch64)/Mac(x86/arm64)
TensorRT Nvidia GPU Paddle/ONNX Windows(x64)/Linux(x64)/Jetson
OpenVINO CPU Paddle/ONNX Windows(x64)/Linux(x64)/Mac(x86)

Example code

Related APIs

Vision Models

Task Model API Example
object detection PaddleDetection/PPYOLOE fastdeploy::vision::detection::PPYOLOE C++/Python