Files
FastDeploy/docs/runtime/README.md
Jason 0dd9ecee65 Optimize ocr system code (#209)
* Support PPYOLOE plus model

* Optimize ocr system code

* modify example code

* fix patchelf of openvino

* optimize demo code of ocr

* remove debug code

* update demo code of ocr

Co-authored-by: Jack Zhou <zhoushunjie@baidu.com>
2022-09-14 09:46:03 +08:00

928 B
Raw Blame History

FastDeploy推理后端

FastDeploy当前已集成多种推理后端如下表格列出FastDeploy集成的各后端与在FastDeploy中其支持的平台、硬件等信息

推理后端 支持平台 支持硬件 支持模型格式
Paddle Inference Windows(x64)/Linux(x64) GPU/CPU Paddle
ONNX Runtime Windows(x64)/Linux(x64/aarch64) GPU/CPU Paddle/ONNX
TensorRT Windows(x64)/Linux(x64/jetson) GPU Paddle/ONNX
OpenVINO Windows(x64)/Linux(x64) CPU Paddle/ONNX
Poros[进行中] Linux(x64) CPU/GPU TorchScript

FastDeploy中各后端独立用户在自行编译时可以选择开启其中一种或多种后端FastDeploy中的Runtime模块为所有后端提供了统一的使用APIRuntime使用方式参阅文档FastDeploy Runtime使用文档

其它文档