diff --git a/README_EN.md b/README_EN.md index 666ab3858..92bce8753 100644 --- a/README_EN.md +++ b/README_EN.md @@ -18,7 +18,8 @@ English | [简体中文](README_CN.md) -**⚡️FastDeploy** is an **accessible and efficient** deployment Development Toolkit. It covers 🔥**critical CV、NLP、Speech AI models** in the industry and provides 📦**out-of-the-box** deployment experience. It covers image classification, object detection, image segmentation, face detection, face recognition, human keypoint detection, OCR, semantic understanding and other tasks to meet developers' industrial deployment needs for **multi-scenario**, **multi-hardware** and **multi-platform** . +**⚡️FastDeploy** is an **Easy-to-use** and **High Performance** AI model deployment toolkit for Cloud and Edge with 📦**out-of-the-box and unified experience**, 🔚**end-to-end optimization** for over **🔥150+ Text, Vision, Speech and Cross-modal AI models**. +Including image classification, object detection, image segmentation, face detection, face recognition, keypoint detection, matting, OCR, NLP, TTS and other tasks to meet developers' industrial deployment needs for **multi-scenario**, **multi-hardware** and **multi-platform**. | [Image Classification](examples/vision/classification) | [Object Detection](examples/vision/detection) | [Semantic Segmentation](examples/vision/segmentation/paddleseg) | [Potrait Segmentation](examples/vision/segmentation/paddleseg) | |:---------------------------------------------------------------------------------------------------------:|:---------------------------------------------------------------------------------------------------------:|:--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------:|:-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------:| @@ -31,10 +32,10 @@ English | [简体中文](README_CN.md) ## 📣 Recent Updates -- 🔥 **【Live Preview】2022.11.09 20:30～21:30，《Covering the full spectrum of cloud-side scenarios with 150+ popular models for rapid deployment》** -- 🔥 **【Live Preview】2022.11.10 20:30～21:30，《10+ AI hardware deployments from Rockchip, Amlogic, NXP and others, straight to industry landing》** -- 🔥 **【Live Preview】2022.11.10 19:00～20:00，《10+ popular models deployed in RK3588, RK3568 in action》** - - **Slack**：Join our [Slack community](https://join.slack.com/t/fastdeployworkspace/shared_invite/zt-1hhvpb279-iw2pNPwrDaMBQ5OQhO3Siw) and chat with other community members about ideas +- 🔥【Live Preview】2022.11.09 20:30～21:30，*Covering the full spectrum of cloud-side scenarios with 150+ popular models for rapid deployment* +- 🔥【Live Preview】2022.11.10 20:30～21:30，*10+ AI hardware deployments from Rockchip, Amlogic, NXP and others, straight to industry landing* +- 🔥【Live Preview】2022.11.10 19:00～20:00，*10+ popular models deployed in RK3588, RK3568 in action* + - **Slack**：Join our [Slack community](https://join.slack.com/t/fastdeployworkspace/shared_invite/zt-1hhvpb279-iw2pNPwrDaMBQ5OQhO3Siw) and chat with other community members about ideas. - **WeChat**：Scan the QR code below using WeChat, follow the PaddlePaddle official account and fill out the questionnaire to join the WeChat group
@@ -42,23 +43,23 @@ English | [简体中文](README_CN.md) - 🔥 **2022.10.31：Release FastDeploy [release v0.5.0](https://github.com/PaddlePaddle/FastDeploy/tree/release/0.5.0)**
- - **🖥️ Data Center and Cloud Deployment: Support more backend, Support more CV models** + - **🖥️ Server-side and Cloud Deployment: Support more backend, Support more CV models** - Support Paddle Inference TensorRT, and provide a seamless deployment experience with other inference engines include Paddle Inference、Paddle Lite、TensorRT、OpenVINO、ONNX Runtime； - Support Graphcore IPU through paddle Inference; - Support tracking model [PP-Tracking](./examples/vision/tracking/pptracking) and [RobustVideoMatting](./examples/vision/matting) model； - Support [one-click model quantization](tools/quantization) to improve model inference speed by 1.5 to 2 times on CPU & GPU platform. The supported quantized model are YOLOv7, YOLOv6, YOLOv5, etc. - 🔥 **2022.10.24：Release FastDeploy [release v0.4.0](https://github.com/PaddlePaddle/FastDeploy/tree/release/0.4.0)**
- - **🖥️ Data Center and Cloud Deployment: end-to-end optimization, Support more CV and NLP model** + - **🖥️ Server-side and Cloud Deployment: end-to-end optimization, Support more CV and NLP model** - end-to-end optimization on GPU, [YOLO series](examples/vision/detection) model end-to-end inference speedup from 43ms to 25ms; - Support CV models include PP-OCRv3, PP-OCRv2, PP-TinyPose, PP-Matting, etc. and provides [end-to-end deployment demos](examples/vision/detection/); - Support information extraction model is UIE, and provides [end-to-end deployment demos](examples/text/uie); - Support [TinyPose](examples/vision/keypointdetection/tiny_pose) and [PicoDet and TinyPose](examples/vision/keypointdetection/det_keypoint_unite)Pipeline deployment. - - **📲 Mobile and Edge Device Deployment: support new backend，support more CV model** + - **📱 Mobile and Edge Device Deployment: support new backend，support more CV model** - Integrate Paddle Lite and provide a seamless deployment experience with other inference engines include TensorRT、OpenVINO、ONNX Runtime、Paddle Inference； - Support [Lightweight Detection Model](examples/vision/detection/paddledetection/android) and [classification model](examples/vision/classification/paddleclas/android) on Android Platform，Download to try it out. - - **Web-Side Deployment: support more CV model** - - Web deployment and Mini Program deployment New [OCR and other CV models](examples/application/js) capability. + - **🌐 Browser Deployment: support more CV model** + - Browser deployment and Mini Program deployment New [OCR and other CV models](examples/application/js) capability. ## Contents @@ -93,20 +94,20 @@ English | [简体中文](README_CN.md) - [Benchmark Testing](./benchmark)
-* **🖥️ Data Center and Cloud Deployment** +* **🖥️ Server-side and Cloud Deployment** * [A Quick Start for Python SDK](#fastdeploy-quick-start-python) * [A Quick Start for C++ SDK](#fastdeploy-quick-start-cpp) - * [Supported Data Center and Cloud Model List](#fastdeploy-server-models) -* **📲 Mobile and Edge Device Deployment** + * [Supported Server-side and Cloud Model List](#fastdeploy-server-models) +* **📱 Mobile and Edge Device Deployment** * [Paddle Lite NPU Deployment](#fastdeploy-edge-sdk-npu) * [Supported Mobile and Edge Model List](#fastdeploy-edge-models) -* **Web and Mini Program Deployment** +* **🌐 Browser and Mini Program Deployment** * [Supported Web and Mini Program Model List](#fastdeploy-web-models) * [**Community**](#fastdeploy-community) * [**Acknowledge**](#fastdeploy-acknowledge) * [**License**](#fastdeploy-license) -## 🖥️ Data Center and Cloud Deployment +## 🖥️ Server-side and Cloud Deployment
@@ -121,7 +122,7 @@ English | [简体中文](README_CN.md) - CUDA >= 11.2 、cuDNN >= 8.0 、 Python >= 3.6 - OS: Linux x86_64/macOS/Windows 10 -##### Install Fastdeploy SDK with CPU&GPU support +##### Install FastDeploy SDK with both CPU and GPU support ```bash pip install fastdeploy-gpu-python -f https://www.paddlepaddle.org.cn/whl/fastdeploy.html @@ -133,7 +134,7 @@ pip install fastdeploy-gpu-python -f https://www.paddlepaddle.org.cn/whl/fastdep conda config --add channels conda-forge && conda install cudatoolkit=11.2 cudnn=8.2 ``` -##### Install Fastdeploy SDK with only CPU support +##### Install FastDeploy SDK with only CPU support ```bash pip install fastdeploy-python -f https://www.paddlepaddle.org.cn/whl/fastdeploy.html @@ -141,7 +142,7 @@ pip install fastdeploy-python -f https://www.paddlepaddle.org.cn/whl/fastdeploy. #### Python Inference Example -* Prepare models and pictures +* Prepare model and picture ```bash wget https://bj.bcebos.com/paddlehub/fastdeploy/ppyoloe_crn_l_300e_coco.tgz @@ -156,11 +157,11 @@ wget https://gitee.com/paddlepaddle/PaddleDetection/raw/release/2.4/demo/0000000 import cv2 import fastdeploy.vision as vision - +im = cv2.imread("000000014439.jpg") model = vision.detection.PPYOLOE("ppyoloe_crn_l_300e_coco/model.pdmodel", "ppyoloe_crn_l_300e_coco/model.pdiparams", "ppyoloe_crn_l_300e_coco/infer_cfg.yml") -im = cv2.imread("000000014439.jpg") + result = model.predict(im) print(result) @@ -196,10 +197,10 @@ wget https://gitee.com/paddlepaddle/PaddleDetection/raw/release/2.4/demo/0000000 int main(int argc, char* argv[]) { namespace vision = fastdeploy::vision; + auto im = cv::imread("000000014439.jpg"); auto model = vision::detection::PPYOLOE("ppyoloe_crn_l_300e_coco/model.pdmodel", "ppyoloe_crn_l_300e_coco/model.pdiparams", "ppyoloe_crn_l_300e_coco/infer_cfg.yml"); - auto im = cv::imread("000000014439.jpg"); vision::DetectionResult res; model.Predict(&im, &res); @@ -216,7 +217,7 @@ For more deployment models, please refer to [Vision Model Deployment Examples](e
-### Supported Data Center and Web Model List🔥🔥🔥🔥🔥 +### Server-side and Cloud Model List🔥🔥🔥🔥🔥 Notes: ✅: already supported; ❔: to be supported in the future; N/A: Not Available; @@ -294,7 +295,7 @@ Notes: ✅: already supported; ❔: to be supported in the future; N/A: Not Ava
-## 📲 Mobile and Edge Device Deployment +## 📱 Mobile and Edge Device Deployment
@@ -305,7 +306,7 @@ Notes: ✅: already supported; ❔: to be supported in the future; N/A: Not Ava
-### Supported Mobile and Edge Model List 🔥🔥🔥🔥 +### Mobile and Edge Model List 🔥🔥🔥🔥
@@ -351,7 +352,7 @@ Notes: ✅: already supported; ❔: to be supported in the future; N/A: Not Ava | OCR | PaddleOCR/PP-OCRv3-tiny | 2.4+10.7 | ❔ | ❔ | ❔ | ❔ | -- | -- | -- | -- | -## Web and Mini Program Deployment +## 🌐 Browser-based Model List
@@ -379,8 +380,6 @@ Notes: ✅: already supported; ❔: to be supported in the future; N/A: Not Ava
- - ## Acknowledge