mirror of
https://github.com/PaddlePaddle/FastDeploy.git
synced 2025-12-24 13:28:13 +08:00
bd7caa17b8
* Update README.md * Update README.md * Update README.md * Create README.md * Update README.md * Update README.md * Update README.md * Update README.md * Add evaluation calculate time and fix some bugs * Update classification __init__ * Move to ppseg * Add segmentation doc * Add PaddleClas infer.py * Update PaddleClas infer.py * Delete .infer.py.swp Co-authored-by: Jason <jiangjiajun@baidu.com>
⚡️FastDeploy
特性 | 服务器端 | 端侧 | 社区交流
⚡️FastDeploy是一款简单易用的推理部署工具箱。覆盖业界主流优质预训练模型并提供开箱即用的开发体验，包括图像分类、目标检测、图像分割、人脸检测、人体关键点识别、文字识别等多任务，满足开发者多场景，多硬件、多平台的快速部署需求。
支持模型
| 任务场景 | 模型 | X64 CPU | Nvidia-GPU | Nvidia-GPU TensorRT |
|---|---|---|---|---|
| 图像分类 | PaddleClas/ResNet50 | √ | √ | √ |
| PaddleClas/PPLCNet | √ | √ | √ | |
| PaddleClas/EfficientNet | √ | √ | √ | |
| PaddleClas/GhostNet | √ | √ | √ | |
| PaddleClas/MobileNetV1 | √ | √ | √ | |
| PaddleClas/MobileNetV2 | √ | √ | √ | |
| PaddleClas/ShuffleNetV2 | √ | √ | √ | |
| 目标检测 | PaddleDetection/PPYOLOE | √ | √ | √ |
| PaddleDetection/PicoDet | √ | √ | √ | |
| PaddleDetection/YOLOX | √ | √ | √ | |
| PaddleDetection/YOLOv3 | √ | √ | √ | |
| PaddleDetection/PPYOLO | √ | √ | - | |
| PaddleDetection/PPYOLOv2 | √ | √ | - | |
| PaddleDetection/FasterRCNN | √ | √ | - |
快速开始
📱轻量化SDK快速实现端侧AI推理部署
| 任务场景 | 模型 | 大小(MB) | 边缘端 | 移动端 | 移动端 |
|---|---|---|---|---|---|
| ---- | --- | --- | Linux | Android | iOS |
| ----- | ---- | --- | ARM CPU | ARM CPU | ARM CPU |
| Classfication | PP-LCNet | 11.9 | ✅ | ✅ | ✅ |
| PP-LCNetv2 | 26.6 | ✅ | ✅ | ✅ | |
| EfficientNet | 31.4 | ✅ | ✅ | ✅ | |
| GhostNet | 20.8 | ✅ | ✅ | ✅ | |
| MobileNetV1 | 17 | ✅ | ✅ | ✅ | |
| MobileNetV2 | 14.2 | ✅ | ✅ | ✅ | |
| MobileNetV3 | 22 | ✅ | ✅ | ✅ | |
| ShuffleNetV2 | 9.2 | ✅ | ✅ | ✅ | |
| SqueezeNetV1.1 | 5 | ✅ | ✅ | ✅ | |
| Inceptionv3 | 95.5 | ✅ | ✅ | ✅ | |
| PP-HGNet | 59 | ✅ | ✅ | ✅ | |
| SwinTransformer_224_win7 | 352.7 | ✅ | ✅ | ✅ | |
| Detection | PP-PicoDet_s_320_coco | 4.1 | ✅ | ✅ | ✅ |
| PP-PicoDet_s_320_lcnet | 4.9 | ✅ | ✅ | ✅ | |
| CenterNet | 4.8 | ✅ | ✅ | ✅ | |
| YOLOv3_MobileNetV3 | 94.6 | ✅ | ✅ | ✅ | |
| PP-YOLO_tiny_650e_coco | 4.4 | ✅ | ✅ | ✅ | |
| SSD_MobileNetV1_300_120e_voc | 23.3 | ✅ | ✅ | ✅ | |
| PP-YOLO_ResNet50vd | 188.5 | ✅ | ✅ | ✅ | |
| PP-YOLOv2_ResNet50vd | 218.7 | ✅ | ✅ | ✅ | |
| PP-YOLO_crn_l_300e_coco | 209.1 | ✅ | ✅ | ✅ | |
| YOLOv5s | 29.3 | ✅ | ✅ | ✅ | |
| Face Detection | BlazeFace | 1.5 | ✅ | ✅ | ✅ |
| Face Localisation | RetinaFace | 1.7 | ✅ | ❌ | ❌ |
| Keypoint Detection | PP-TinyPose | 5.5 | ✅ | ✅ | ✅ |
| Segmentation | PP-LiteSeg(STDC1) | 32.2 | ✅ | ✅ | ✅ |
| PP-HumanSeg-Lite | 0.556 | ✅ | ✅ | ✅ | |
| HRNet-w18 | 38.7 | ✅ | ✅ | ✅ | |
| PP-HumanSeg-Server | 107.2 | ✅ | ✅ | ✅ | |
| Unet | 53.7 | ❌ | ✅ | ❌ | |
| OCR | PP-OCRv1 | 2.3+4.4 | ✅ | ✅ | ✅ |
| PP-OCRv2 | 2.3+4.4 | ✅ | ✅ | ✅ | |
| PP-OCRv3 | 2.4+10.6 | ✅ | ✅ | ✅ | |
| PP-OCRv3-tiny | 2.4+10.7 | ✅ | ✅ | ✅ |
边缘侧部署
- ARM Linux 系统
移动端部署
自定义模型部署
社区交流
- 加入社区👬： 微信扫描二维码后，填写问卷加入交流群，与开发者共同讨论推理部署痛点问题
Acknowledge
本项目中SDK生成和下载使用了EasyEdge中的免费开放能力，再次表示感谢。
License
FastDeploy遵循Apache-2.0开源协议。