apps/FastDeploy
1
0
Fork 0
mirror of https://github.com/PaddlePaddle/FastDeploy.git synced 2025-12-24 13:28:13 +08:00
Code Issues Actions 2 Packages Projects Releases Wiki Activity

Update README_EN.md

Browse Source
This commit is contained in:
Zeyu Chen
2022-11-12 12:02:02 +08:00
committed by GitHub
parent f74974c4a5
commit 0a39b2c5dd
1 changed files with 26 additions and 27 deletions
Download Patch File Download Diff File Expand all files Collapse all files

53
README_EN.md
View File

@@ -18,7 +18,8 @@ English | [简体中文](README_CN.md)
**⚡️FastDeploy** is an **accessible and efficient** deployment Development Toolkit. It covers 🔥**critical CV、NLP、Speech AI models** in the industry and provides 📦**out-of-the-box** deployment experience. It covers image classification, object detection, image segmentation, face detection, face recognition, human keypoint detection, OCR, semantic understanding and other tasks to meet developers' industrial deployment needs for **multi-scenario**, **multi-hardware** and **multi-platform** .
**⚡️FastDeploy** is an **Easy-to-use** and **High Performance** AI model deployment toolkit for Cloud and Edge with 📦**out-of-the-box and unified experience**, 🔚**end-to-end optimization** for over **🔥150+ Text, Vision, Speech and Cross-modal AI models**.
Including image classification, object detection, image segmentation, face detection, face recognition, keypoint detection, matting, OCR, NLP, TTS and other tasks to meet developers' industrial deployment needs for **multi-scenario**, **multi-hardware** and **multi-platform**.
| [Image Classification](examples/vision/classification) | [Object Detection](examples/vision/detection) | [Semantic Segmentation](examples/vision/segmentation/paddleseg) | [Potrait Segmentation](examples/vision/segmentation/paddleseg) |
|:---------------------------------------------------------------------------------------------------------:|:---------------------------------------------------------------------------------------------------------:|:--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------:|:-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------:|
@@ -31,10 +32,10 @@ English | [简体中文](README_CN.md)
## 📣 Recent Updates
- 🔥 **【Live Preview】2022.11.09 20:30～21:30，《Covering the full spectrum of cloud-side scenarios with 150+ popular models for rapid deployment》**
- 🔥 **【Live Preview】2022.11.10 20:30～21:30，《10+ AI hardware deployments from Rockchip, Amlogic, NXP and others, straight to industry landing》**
- 🔥 **【Live Preview】2022.11.10 19:00～20:00，《10+ popular models deployed in RK3588, RK3568 in action》**
- **Slack**：Join our [Slack community](https://join.slack.com/t/fastdeployworkspace/shared_invite/zt-1hhvpb279-iw2pNPwrDaMBQ5OQhO3Siw) and chat with other community members about ideas
- 🔥【Live Preview】2022.11.09 20:30～21:30，*Covering the full spectrum of cloud-side scenarios with 150+ popular models for rapid deployment*
- 🔥【Live Preview】2022.11.10 20:30～21:30，*10+ AI hardware deployments from Rockchip, Amlogic, NXP and others, straight to industry landing*
- 🔥【Live Preview】2022.11.10 19:00～20:00，*10+ popular models deployed in RK3588, RK3568 in action*
- **Slack**：Join our [Slack community](https://join.slack.com/t/fastdeployworkspace/shared_invite/zt-1hhvpb279-iw2pNPwrDaMBQ5OQhO3Siw) and chat with other community members about ideas.
- **WeChat**：Scan the QR code below using WeChat, follow the PaddlePaddle official account and fill out the questionnaire to join the WeChat group
<div align="center">
<img src="https://user-images.githubusercontent.com/54695910/200145290-d5565d18-6707-4a0b-a9af-85fd36d35d13.jpg" width = "120" height = "120" />
@@ -42,23 +43,23 @@ English | [简体中文](README_CN.md)
- 🔥 **2022.10.31：Release FastDeploy [release v0.5.0](https://github.com/PaddlePaddle/FastDeploy/tree/release/0.5.0)** <br>
- **🖥️ Data Center and Cloud Deployment: Support more backend, Support more CV models**
- **🖥️ Server-side and Cloud Deployment: Support more backend, Support more CV models**
- Support Paddle Inference TensorRT, and provide a seamless deployment experience with other inference engines include Paddle Inference、Paddle Lite、TensorRT、OpenVINO、ONNX Runtime；
- Support Graphcore IPU through paddle Inference;
- Support tracking model [PP-Tracking](./examples/vision/tracking/pptracking) and [RobustVideoMatting](./examples/vision/matting) model；
- Support [one-click model quantization](tools/quantization) to improve model inference speed by 1.5 to 2 times on CPU & GPU platform. The supported quantized model are YOLOv7, YOLOv6, YOLOv5, etc.
- 🔥 **2022.10.24：Release FastDeploy [release v0.4.0](https://github.com/PaddlePaddle/FastDeploy/tree/release/0.4.0)** <br>
- **🖥️ Data Center and Cloud Deployment: end-to-end optimization, Support more CV and NLP model**
- **🖥️ Server-side and Cloud Deployment: end-to-end optimization, Support more CV and NLP model**
- end-to-end optimization on GPU, [YOLO series](examples/vision/detection) model end-to-end inference speedup from 43ms to 25ms;
- Support CV models include PP-OCRv3, PP-OCRv2, PP-TinyPose, PP-Matting, etc. and provides [end-to-end deployment demos](examples/vision/detection/);
- Support information extraction model is UIE, and provides [end-to-end deployment demos](examples/text/uie);
- Support [TinyPose](examples/vision/keypointdetection/tiny_pose) and [PicoDet and TinyPose](examples/vision/keypointdetection/det_keypoint_unite)Pipeline deployment.
- **📲 Mobile and Edge Device Deployment: support new backend，support more CV model**
- **📱 Mobile and Edge Device Deployment: support new backend，support more CV model**
- Integrate Paddle Lite and provide a seamless deployment experience with other inference engines include TensorRT、OpenVINO、ONNX Runtime、Paddle Inference；
- Support [Lightweight Detection Model](examples/vision/detection/paddledetection/android) and [classification model](examples/vision/classification/paddleclas/android) on Android Platform，Download to try it out.
- **<img src="https://user-images.githubusercontent.com/54695910/200179541-05f8e187-9f8b-444c-9252-d9ce3f1ab05f.png" width = "18" height = "18" />Web-Side Deployment: support more CV model**
- Web deployment and Mini Program deployment New [OCR and other CV models](examples/application/js) capability.
- **🌐 Browser Deployment: support more CV model**
- Browser deployment and Mini Program deployment New [OCR and other CV models](examples/application/js) capability.
## Contents
@@ -93,20 +94,20 @@ English | [简体中文](README_CN.md)
- [Benchmark Testing](./benchmark)
</div></details>
* **🖥️ Data Center and Cloud Deployment**
* **🖥️ Server-side and Cloud Deployment**
* [A Quick Start for Python SDK](#fastdeploy-quick-start-python)
* [A Quick Start for C++ SDK](#fastdeploy-quick-start-cpp)
* [Supported Data Center and Cloud Model List](#fastdeploy-server-models)
* **📲 Mobile and Edge Device Deployment**
* [Supported Server-side and Cloud Model List](#fastdeploy-server-models)
* **📱 Mobile and Edge Device Deployment**
* [Paddle Lite NPU Deployment](#fastdeploy-edge-sdk-npu)
* [Supported Mobile and Edge Model List](#fastdeploy-edge-models)
* **<img src="https://user-images.githubusercontent.com/54695910/200179541-05f8e187-9f8b-444c-9252-d9ce3f1ab05f.png" width = "18" height = "18" />Web and Mini Program Deployment**
* **🌐 Browser and Mini Program Deployment**
* [Supported Web and Mini Program Model List](#fastdeploy-web-models)
* [**Community**](#fastdeploy-community)
* [**Acknowledge**](#fastdeploy-acknowledge)
* [**License**](#fastdeploy-license)
## 🖥️ Data Center and Cloud Deployment
## 🖥️ Server-side and Cloud Deployment
<div id="fastdeploy-quick-start-python"></div>
@@ -121,7 +122,7 @@ English | [简体中文](README_CN.md)
- CUDA >= 11.2 、cuDNN >= 8.0 、 Python >= 3.6
- OS: Linux x86_64/macOS/Windows 10
##### Install Fastdeploy SDK with CPU&GPU support
##### Install FastDeploy SDK with both CPU and GPU support
```bash
pip install fastdeploy-gpu-python -f https://www.paddlepaddle.org.cn/whl/fastdeploy.html
@@ -133,7 +134,7 @@ pip install fastdeploy-gpu-python -f https://www.paddlepaddle.org.cn/whl/fastdep
conda config --add channels conda-forge && conda install cudatoolkit=11.2 cudnn=8.2
```
##### Install Fastdeploy SDK with only CPU support
##### Install FastDeploy SDK with only CPU support
```bash
pip install fastdeploy-python -f https://www.paddlepaddle.org.cn/whl/fastdeploy.html
@@ -141,7 +142,7 @@ pip install fastdeploy-python -f https://www.paddlepaddle.org.cn/whl/fastdeploy.
#### Python Inference Example
* Prepare models and pictures
* Prepare model and picture
```bash
wget https://bj.bcebos.com/paddlehub/fastdeploy/ppyoloe_crn_l_300e_coco.tgz
@@ -156,11 +157,11 @@ wget https://gitee.com/paddlepaddle/PaddleDetection/raw/release/2.4/demo/0000000
import cv2
import fastdeploy.vision as vision
im = cv2.imread("000000014439.jpg")
model = vision.detection.PPYOLOE("ppyoloe_crn_l_300e_coco/model.pdmodel",
"ppyoloe_crn_l_300e_coco/model.pdiparams",
"ppyoloe_crn_l_300e_coco/infer_cfg.yml")
im = cv2.imread("000000014439.jpg")
result = model.predict(im)
print(result)
@@ -196,10 +197,10 @@ wget https://gitee.com/paddlepaddle/PaddleDetection/raw/release/2.4/demo/0000000
int main(int argc, char* argv[]) {
namespace vision = fastdeploy::vision;
auto im = cv::imread("000000014439.jpg");
auto model = vision::detection::PPYOLOE("ppyoloe_crn_l_300e_coco/model.pdmodel",
"ppyoloe_crn_l_300e_coco/model.pdiparams",
"ppyoloe_crn_l_300e_coco/infer_cfg.yml");
auto im = cv::imread("000000014439.jpg");
vision::DetectionResult res;
model.Predict(&im, &res);
@@ -216,7 +217,7 @@ For more deployment models, please refer to [Vision Model Deployment Examples](e
<div id="fastdeploy-server-models"></div>
### Supported Data Center and Web Model List🔥🔥🔥🔥🔥
### Server-side and Cloud Model List🔥🔥🔥🔥🔥
Notes: ✅: already supported; ❔: to be supported in the future; N/A: Not Available;
@@ -294,7 +295,7 @@ Notes: ✅: already supported; ❔: to be supported in the future; N/A: Not Ava
<div id="fastdeploy-edge-doc"></div>
## 📲 Mobile and Edge Device Deployment
## 📱 Mobile and Edge Device Deployment
<div id="fastdeploy-edge-sdk-npu"></div>
@@ -305,7 +306,7 @@ Notes: ✅: already supported; ❔: to be supported in the future; N/A: Not Ava
<div id="fastdeploy-edge-models"></div>
### Supported Mobile and Edge Model List 🔥🔥🔥🔥
### Mobile and Edge Model List 🔥🔥🔥🔥
<div align="center">
<img src="https://user-images.githubusercontent.com/54695910/198620704-741523c1-dec7-44e5-9f2b-29ddd9997344.png" />
@@ -351,7 +352,7 @@ Notes: ✅: already supported; ❔: to be supported in the future; N/A: Not Ava
| OCR | PaddleOCR/PP-OCRv3-tiny | 2.4+10.7 | ❔ | ❔ | ❔ | ❔ | -- | -- | -- | -- |
## <img src="https://user-images.githubusercontent.com/54695910/200179541-05f8e187-9f8b-444c-9252-d9ce3f1ab05f.png" width = "18" height = "18" /> Web and Mini Program Deployment
## 🌐 Browser-based Model List
<div id="fastdeploy-web-models"></div>
@@ -379,8 +380,6 @@ Notes: ✅: already supported; ❔: to be supported in the future; N/A: Not Ava
<img src="https://user-images.githubusercontent.com/54695910/200145290-d5565d18-6707-4a0b-a9af-85fd36d35d13.jpg" width = "225" height = "225" />
</div>
## Acknowledge
<div id="fastdeploy-acknowledge"></div>