apps/FastDeploy
1
0
Fork 0
mirror of https://github.com/PaddlePaddle/FastDeploy.git synced 2025-10-06 17:17:14 +08:00
Code Issues Actions 2 Packages Projects Releases Wiki Activity
Files
d57e997fa02eef3a4c61c403f7845080f552cac3
FastDeploy/fastdeploy
History
heliqi d57e997fa0 Fd serving add docker images correlation and docs (#311) 
* fd serving add dockerfile

* fix enable_paddle_mkldnn

* delete disable_paddle_mkldnn

Co-authored-by: Jason <jiangjiajun@baidu.com>
2022-10-08 16:08:07 +08:00
..
backends
add override mark (#312)
2022-10-07 11:38:31 +08:00
core
Add PP-ModNet and PP-HumanMatting Support (#240)
2022-10-07 21:44:16 +08:00
function
Upgrade eigen func (#253)
2022-09-20 10:58:07 +08:00
libs
Refine cpp/python api of visualize with lots of deprecated apis (#303)
2022-09-29 14:06:45 +08:00
pybind
Fd serving add docker images correlation and docs (#311)
2022-10-08 16:08:07 +08:00
text
Rename fastdeploy_runtime.h to runtime.h and Frontend to ModelFormat (#263)
2022-09-22 13:24:05 +08:00
utils
Add paddlelite backend support (#260)
2022-09-21 13:22:34 +08:00
vision
Add PP-ModNet and PP-HumanMatting Support (#240)
2022-10-07 21:44:16 +08:00
CMakeLists.txt
Modify file structure to separate python and cpp code (#223)
2022-09-14 15:44:13 +08:00
fastdeploy_model.cc
Remove debug code (#266)
2022-09-22 15:18:50 +08:00
fastdeploy_model.h
Add some comments for ppyoloe (#324)
2022-10-07 20:41:04 +08:00
README.md
Add some comments for ppyoloe (#324)
2022-10-07 20:41:04 +08:00
runtime.cc
Fd serving add docker images correlation and docs (#311)
2022-10-08 16:08:07 +08:00
runtime.h
Fd serving add docker images correlation and docs (#311)
2022-10-08 16:08:07 +08:00
text.h
Modify file structure to separate python and cpp code (#223)
2022-09-14 15:44:13 +08:00
vision.h
Modify file structure to separate python and cpp code (#223)
2022-09-14 15:44:13 +08:00

README.md

FastDeploy C++ API Summary

Runtime

FastDeploy Runtime can be used as an inference engine with the same code, we can deploy Paddle/ONNX model on different device by different backends.
Currently, FastDeploy supported backends listed as below,

Backend Hardware Support Model Format Platform
Paddle Inference CPU/Nvidia GPU Paddle Windows(x64)/Linux(x64)
ONNX Runtime CPU/Nvidia GPU Paddle/ONNX Windows(x64)/Linux(x64/aarch64)/Mac(x86/arm64)
TensorRT Nvidia GPU Paddle/ONNX Windows(x64)/Linux(x64)/Jetson
OpenVINO CPU Paddle/ONNX Windows(x64)/Linux(x64)/Mac(x86)

Example code

Related APIs

Vision Models

Task Model API Example
object detection PaddleDetection/PPYOLOE fastdeploy::vision::detection::PPYOLOE C++/Python