mirror of https://github.com/PaddlePaddle/FastDeploy.git synced 2025-10-06 09:07:10 +08:00

Files

charl-u 2e8632ce37 [Doc]Update README_EN.md (#1173 )

* 第一次提交

* 补充一处漏翻译

* deleted:    docs/en/quantize.md

* Update one translation

* Update en version

* Update one translation in code

* Standardize one writing

* Standardize one writing

* Update some en version

* Fix a grammer problem

* Update en version for api/vision result

* Merge branch 'develop' of https://github.com/charl-u/FastDeploy into develop

* Checkout the link in README in vision_results/ to the en documents

* Modify a title

* Add link to serving/docs/

* Finish translation of demo.md

* Update english version of serving/docs/

* Update title of readme

* Update some links

* Modify a title

* Update some links

* Update en version of java android README

* Modify some titles

* Modify some titles

* Modify some titles

* modify article to document

* update some english version of documents in examples

* Add english version of documents in examples/visions

* Sync to current branch

* Add english version of documents in examples

* Add english version of documents in examples

* Add english version of documents in examples

* Update some documents in examples

* Update some documents in examples

* Update some documents in examples

* Update some documents in examples

* Update some documents in examples

* Update some documents in examples

* Update some documents in examples

* Update some documents in examples

* Update some documents in examples

* update README

* update Readme.md

* update Readme.md

* update Readme_en.md

* update Readme_en.md

* Update README_EN.md

* Update README_CN.md

* Update README_EN.md

* Delete README_new.md

* Update README_EN.md

* Update README.md

* Update rknpu2.md

* Update README.md

* Update README.md

* Create README_CN.md

* Update README.md

* Update README_CN.md

* Update README.md

* Update README_EN.md

---------

Co-authored-by: leiqing <54695910+leiqing1@users.noreply.github.com>

2023-01-28 19:01:01 +08:00

3.0 KiB

Raw Blame History

English | 中文

RKNPU2 Model Deployment

Installation Environment

RKNPU2 model export is only supported on x86 Linux platform, please refer to RKNPU2 Model Export Environment Configuration.

Convert ONNX to RKNN

Since the ONNX model cannot directly calculate by calling the NPU, it is necessary to convert the ONNX model to RKNN model. For detailed information, please refer to RKNPU2 Conversion Document.

Models supported for RKNPU2

The following tests are at end-to-end speed, and the test environment is as follows:

Device Model: RK3588
ARM CPU is tested on ONNX
with single-core NPU

Mission Scenario	Model	Model Version(tested version)	ARM CPU/RKNN speed(ms)
Detection	Picodet	Picodet-s	162/112
Detection	RKYOLOV5	YOLOV5-S-Relu(int8)	-/57
Detection	RKYOLOX	-	-/-
Detection	RKYOLOV7	-	-/-
Segmentation	Unet	Unet-cityscapes	-/-
Segmentation	PP-HumanSegV2Lite	portrait(int8)	133/43
Segmentation	PP-HumanSegV2Lite	human(int8)	133/43
Face Detection	SCRFD	SCRFD-2.5G-kps-640(int8)	108/42
Face FaceRecognition	InsightFace	ms1mv3_arcface_r18(int8)	81/12
Classification	ResNet	ResNet50_vd	-/33

Download Pre-trained library

For convenience, here we provide the 1.0.2 version of FastDeploy.

3.0 KiB Raw Blame History