apps/FastDeploy
1
0
Fork 0
mirror of https://github.com/PaddlePaddle/FastDeploy.git synced 2025-12-24 13:28:13 +08:00
Code Issues Actions 2 Packages Projects Releases Wiki Activity
1,775 Commits 29 Branches 10 Tags
e63f5f369e79deea00895a3f0ee3d24020068574
Commit Graph

1775 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Jack Zhou
e63f5f369e [Backend] Update paddle inference to 2.4-dev5 (#1302) 
update paddle inference to 2.4-dev5
 2023-02-12 15:13:39 +08:00
Jack Zhou
121a30b69f [Other] Update fast_tokenizer version (#1300) 
Update fast_tokenizer version
 2023-02-12 15:13:32 +08:00
Zheng-Bicheng
6a3ac91057 [Model] Update rkyolo pybind (#1294) 
更新rkyolo pybind
 2023-02-11 09:09:53 +08:00
WJJ1995
59a4ab343f [Benchmark]Add ResourceUsageMonitor to collect memory info (#1269) 
* add GPL lisence

* add GPL-3.0 lisence

* add GPL-3.0 lisence

* add GPL-3.0 lisence

* support yolov8

* add pybind for yolov8

* add yolov8 readme

* add cpp benchmark

* add cpu and gpu mem

* public part split

* add runtime mode

* fixed bugs

* add cpu_thread_nums

* deal with comments

* deal with comments

* deal with comments

* rm useless code

* add FASTDEPLOY_DECL

* add FASTDEPLOY_DECL

* fixed for windows

* mv rss to pss

* mv rss to pss

* Update utils.cc

* use thread to collect mem

* Add ResourceUsageMonitor

* rm useless code

* fixed bug

* fixed typo

* update ResourceUsageMonitor

* fixed bug

* fixed bug

* add note for ResourceUsageMonitor

* deal with comments

---------

Co-authored-by: DefTruth <31974251+DefTruth@users.noreply.github.com>
 2023-02-10 17:13:22 +08:00
DefTruth
b732e4c711 [Bug Fix] Add bundle script for text api only pkg (#1295) 
[Android] Add bundle script for text api only pkg
 2023-02-10 12:00:43 +08:00
DefTruth
ce424c313e [XPU] Add XPU option for benchmark example (#1287) 
* [XPU] Add xpu option for benchmark example

* [XPU] Add fp16 flags
 2023-02-10 11:24:40 +08:00
Jack Zhou
1476f15d80 Merge pull request #1283 from wwbitejotunn/ppinfer_trt_bugfix 
[Bug Fix] Paddle backend bug when tensorrt enable
 2023-02-09 23:34:52 +08:00
wwbitejotunn
898b063216 get cache dir 2023-02-09 20:56:55 +08:00
wwbitejotunn
c2e5f6317e fix paddle backend 2023-02-09 20:56:55 +08:00
yeliang2258
4742f97819 [Bug Fix] Fix KunlunXin valid_places (#1285) 
fix KunlunXin valid_places
 2023-02-09 20:39:44 +08:00
leiqing
ea46586953 Update README_CN.md 2023-02-09 19:55:06 +08:00
DefTruth
ab5377b5fa [Benchmark] Add PaddleYOLOv8 cpp benchmark example & lite flags option (#1270) 
* [Android] Add PaddleYOLOv8 cpp benchmark example & lite flags option

* [Benchmark] add linux x86_64 gpu benchmark build script
 2023-02-09 11:58:07 +08:00
chenjian
3eb571a047 [C API] Add c api to fastdeploy (#1217) 
* add c api to test ppclas model

* fix

* add ppdet

* refactor c api code

* remove local test make

* fix a bug

* fix according to review

* format file

* format file

* format file

* add types_internal.cc

---------

Co-authored-by: heliqi <1101791222@qq.com>
 2023-02-09 10:19:40 +08:00
Jason
b8afb0d040 [Other] Move comments for deprecated functions (#1275) 
Move comments for deprecated functions
 2023-02-09 10:04:18 +08:00
yeliang2258
ef852579a9 [Bug Fix] Fix bugs in acc eval (#1276) 
fix bugs in acc eval
 2023-02-09 10:04:04 +08:00
Jack Zhou
fe6cbfdb65 [Doc] Update android doc (#1274) 
* update doc

* Remove text only java sdk

* update doc
 2023-02-08 21:34:51 +08:00
Jason
0fb2f26352 [Other] Optimize sophgo backend (#1273) 
optimize sophgo backend
 2023-02-08 19:50:37 +08:00
CoolCola
79d0ee07c9 [DOC]Renew how to develop a new model file (#1204) 
* renew develop_a_new_model

* renew doc

* update readme file

* fix review problem

* fix review problem

---------

Co-authored-by: WJJ1995 <wjjisloser@163.com>
 2023-02-08 19:46:58 +08:00
yunyaoXYY
bd5630581e [Other] Improve Paddle Lite Ascend lib (#1226) 
* Add Huawei Ascend NPU deploy through PaddleLite CANN

* Add NNAdapter interface for paddlelite

* Modify Huawei Ascend Cmake

* Update way for compiling Huawei Ascend NPU deployment

* remove UseLiteBackend in UseCANN

* Support compile python whlee

* Change names of nnadapter API

* Add nnadapter pybind and remove useless API

* Support Python deployment on Huawei Ascend NPU

* Fix links in readme

* Fix links in readme

* Update PPOCRv2/v3 examples

* Update auto compression configs

* Add neww quantization  support for paddleclas model

* Update quantized Yolov6s model download link

* Improve PPOCR comments

* Add models suppor for ascend

* Add PPOCR rec reszie for ascend

* fix conflict for ascend

* Rename CANN to Ascend

* Rename CANN to Ascend

* Improve ascend

* fix ascend bug

* improve ascend docs

* improve ascend docs

* improve ascend docs

* Add English doc for quantization

* Improve Ascend

* Improve Ascend

* Move ascend python demo

* Imporve ascend

* Fix PPOCR rec model bug

* Improve ascend

* Improve ascend

* Improve ascend

* Improve ascend

* Add  new paddleseg quantization support

* Add  new paddleseg quantization support

* Add  new paddleseg quantization support

* Add  new paddleseg quantization support

* Imporve ascend

* Imporve ascend

* Improve ascend

* acc eval script

* acc eval

* remove acc_eval from branch huawei

* Add detection and segmentation examples for Ascend deployment

* Add detection and segmentation examples for Ascend deployment

* Add Ascend model list

* Add ascend model list

* Add ascend model list

* Add ascend model list

* Add ascend model list

* Add ascend model list

* Add ascend model list

* Add PPOCR example for ascend deploy

* Imporve paddle lite compiliation

* Add FlyCV doc

* Add FlyCV doc

* Add FlyCV doc

* Imporve Ascend docs

* Imporve Ascend docs

* Improve PPOCR example

* Support Ascend deployment on X86 platform

* Improve Ascend docs

* Improve ascend

* Improve ascend

* Change Paddle Lite Ascend URL

* fix ascend docs

* fix ascend docs

* Fix Paddle Lite Ascend Lib

* Imporve compile of Ascend

* Imporve compile of Ascend

* fix paddle lite compile
 2023-02-08 19:46:39 +08:00
Zheng-Bicheng
e077c005df [Bug Fix] Update RKYOLO code format (#1254) 
* 更新rkyolo细节

* 更新rkyolov5 format
 2023-02-08 19:46:11 +08:00
Zheng-Bicheng
8e2b0c1502 [Doc]Update RKNPU2 docs (#1266) 
更新docs
 2023-02-08 19:45:24 +08:00
Jason
a4b0565b9a [Other] Optimize paddle backend (#1265) 
* Optimize paddle backend

* optimize paddle backend

* add version support
 2023-02-08 19:12:03 +08:00
Jack Zhou
60ba4b06c1 Merge pull request #1264 from joey12300/add_android_with_text_only 
[Android] Add script building android package with text only
 2023-02-08 18:59:46 +08:00
Jason
77c5590864 Update use_sdk_on_windows.md 2023-02-08 18:00:54 +08:00
Jason
a1427c430f Update use_sdk_on_windows.md 2023-02-08 17:58:24 +08:00
jiangjiajun
4842d5d5a3 update docs 2023-02-08 09:57:08 +00:00
zhoushunjie
c0cbbfc68a Add fast_tokenizer-lite dependency 2023-02-08 09:29:40 +00:00
zhoushunjie
396a291bc2 update cmake 2023-02-08 09:14:45 +00:00
zhoushunjie
77da47ec8a Add fastdeploy Android doc 2023-02-08 08:52:12 +00:00
zhoushunjie
f8903222bf Add build_android_cpp_with_text_api_only 2023-02-08 08:31:35 +00:00
WJJ1995
66f059b65b [Benchmark] Benchmark cpp for YOLOv5 (#1260) 
* add GPL lisence

* add GPL-3.0 lisence

* add GPL-3.0 lisence

* add GPL-3.0 lisence

* support yolov8

* add pybind for yolov8

* add yolov8 readme

* add cpp benchmark

* add cpu and gpu mem

* public part split

* add runtime mode

* fixed bugs

* add cpu_thread_nums

* deal with comments

* deal with comments

* deal with comments

* rm useless code

* add FASTDEPLOY_DECL

* add FASTDEPLOY_DECL

* fixed for windows

* mv rss to pss

* mv rss to pss

* Update utils.cc

---------

Co-authored-by: DefTruth <31974251+DefTruth@users.noreply.github.com>
 2023-02-08 15:49:28 +08:00
guxukai
9cd00ad4c5 [Model] Refactoring code of YOLOv5Cls with new model type (#1237) 
* Refactoring code of YOLOv5Cls with new model type

* fix reviewed problem

* Normalize&HWC2CHW -> NormalizeAndPermute

* remove cast()
 2023-02-08 11:19:00 +08:00
Jason
c5b414a774 [Other] Unify initialize api for lite/trt backend (#1249) 
* Unify initialize api for lite/trt backend

* Unify initialize api for lite/trt backend
 2023-02-08 11:16:39 +08:00
Zheng-Bicheng
9712f250a5 [Bug Fix] Update picodet rknn export config (#1252) 
更新picodet config
 2023-02-08 11:15:23 +08:00
Zheng-Bicheng
000b8482dd [Bug Fix] Update ppyolov8 rknpu2 export config (#1256) 
更新ppyolov8 模型转换config
 2023-02-08 11:13:44 +08:00
Jason
c25aa71fa9 Revert "[Benchmark]Benchmark cpp for YOLOv5" (#1250) 
Revert "[Benchmark]Benchmark cpp for YOLOv5 (#1224)"

This reverts commit c487359e33.
 2023-02-07 22:14:48 +08:00
WJJ1995
c487359e33 [Benchmark]Benchmark cpp for YOLOv5 (#1224) 
* add GPL lisence

* add GPL-3.0 lisence

* add GPL-3.0 lisence

* add GPL-3.0 lisence

* support yolov8

* add pybind for yolov8

* add yolov8 readme

* add cpp benchmark

* add cpu and gpu mem

* public part split

* add runtime mode

* fixed bugs

* add cpu_thread_nums

* deal with comments

* deal with comments

* deal with comments

* rm useless code

* add FASTDEPLOY_DECL

* add FASTDEPLOY_DECL
 2023-02-07 21:26:04 +08:00
DefTruth
e90e1ff435 [Android] fix flycv android cmake bug (#1248) 2023-02-07 21:20:19 +08:00
Jason
84967e5910 Create common_faq.md 2023-02-07 18:00:30 +08:00
Jason
713afe7f1c [Other] Deprecate some option api and parameters (#1243) 
* Optimize Poros backend

* fix error

* Add more pybind

* fix conflicts

* add some deprecate notices

* [Other] Deprecate some apis in RuntimeOption (#1240)

* Deprecate more options

* modify serving

* Update option.h

* fix tensorrt error

* Update option_pybind.cc

* Update option_pybind.cc

* Fix error in serving

* fix word spell error
 2023-02-07 17:57:46 +08:00
DefTruth
a18cc0f94c [Benchmark] remove redundant args in benchmark_ppdet (#1238) 
* [backend] support bechmark mode for runtime and backend

* [backend] support bechmark mode for runtime and backend

* [pybind11] add benchmark methods pybind

* [pybind11] add benchmark methods pybind

* [Other] Update build scripts

* [Other] Update cmake/summary.cmake

* [Other] update build scripts

* [Other] add ENABLE_BENCHMARK option -> setup.py

* optimize backend time recording

* optimize backend time recording

* optimize trt backend time record

* [backend] optimze backend_time recording for trt

* [benchmark] remove redundant logs

* fixed ov_backend confilct

* [benchmark] fixed paddle_backend conflicts

* [benchmark] fixed paddle_backend conflicts

* [benchmark] fixed paddle_backend conflicts

* [benchmark] remove use_gpu option from ort backend option

* [benchmark] update benchmark_ppdet.py

* [benchmark] update benchmark_ppcls.py

* fixed lite backend conflicts

* [Lite] fixed lite xpu

* add benchmark macro

* add RUNTIME_PROFILE_LOOP macros

* add comments for RUNTIME_PROFILE macros

* add comments for new apis

* add comments for new apis

* update benchmark_ppdet.py

* afixed bugs

* remove unused codes

* optimize RUNTIME_PROFILE_LOOP macros

* optimize RUNTIME_PROFILE_LOOP macros

* add comments for benchmark option and result

* add docs for benchmark namespace

* remove redundant args in benchmark_ppdet
 2023-02-07 16:37:13 +08:00
guxukai
1c115bb237 [Model] Add facedet model: CenterFace (#1131) 
* cpp example run success

* add landmarks

* fix reviewed problem

* add pybind

* add readme in examples

* fix reviewed problem

* new file:   tests/models/test_centerface.py

* fix reviewed problem 230202
 2023-02-07 14:05:08 +08:00
Wang Xinyu
d3d914856d [CVCUDA] Utilize CV-CUDA batch processing function (#1223) 
* norm and permute batch processing

* move cache to mat, batch processors

* get batched tensor logic, resize on cpu logic

* fix cpu compile error

* remove vector mat api

* nits

* add comments

* nits

* fix batch size

* move initial resize on cpu option to use_cuda api

* fix pybind

* processor manager pybind

* rename mat and matbatch

* move initial resize on cpu to ppcls preprocessor

---------

Co-authored-by: Jason <jiangjiajun@baidu.com>
 2023-02-07 13:44:30 +08:00
Jason
7c9bf11c44 [Other] Optimize Poros backend (#1232) 
* Optimize Poros backend

* fix error

* Add more pybind

* fix conflicts

* add some deprecate notices
 2023-02-07 10:18:03 +08:00
DefTruth
f73a538f61 [Backend] support bechmark mode for runtime and backend (#1201) 
* [backend] support bechmark mode for runtime and backend

* [backend] support bechmark mode for runtime and backend

* [pybind11] add benchmark methods pybind

* [pybind11] add benchmark methods pybind

* [Other] Update build scripts

* [Other] Update cmake/summary.cmake

* [Other] update build scripts

* [Other] add ENABLE_BENCHMARK option -> setup.py

* optimize backend time recording

* optimize backend time recording

* optimize trt backend time record

* [backend] optimze backend_time recording for trt

* [benchmark] remove redundant logs

* fixed ov_backend confilct

* [benchmark] fixed paddle_backend conflicts

* [benchmark] fixed paddle_backend conflicts

* [benchmark] fixed paddle_backend conflicts

* [benchmark] remove use_gpu option from ort backend option

* [benchmark] update benchmark_ppdet.py

* [benchmark] update benchmark_ppcls.py

* fixed lite backend conflicts

* [Lite] fixed lite xpu

* add benchmark macro

* add RUNTIME_PROFILE_LOOP macros

* add comments for RUNTIME_PROFILE macros

* add comments for new apis

* add comments for new apis

* update benchmark_ppdet.py

* afixed bugs

* remove unused codes

* optimize RUNTIME_PROFILE_LOOP macros

* optimize RUNTIME_PROFILE_LOOP macros

* add comments for benchmark option and result

* add docs for benchmark namespace
 2023-02-06 14:29:35 +08:00
CoolCola
42d14e7119 [Model] Support BlazeFace Model (#1172) 
* fit yolov7face file path

* TODO：添加yolov7facePython接口Predict

* resolve yolov7face.py

* resolve yolov7face.py

* resolve yolov7face.py

* add yolov7face example readme file

* [Doc] fix yolov7face example readme file

* [Doc]fix yolov7face example readme file

* support BlazeFace

* add blazeface readme file

* fix review problem

* fix code style error

* fix review problem

* fix review problem

* fix head file problem

* fix review problem

* fix review problem

* fix readme file problem

* add English readme file

* fix English readme file
 2023-02-06 14:24:12 +08:00
Hu Chuqi
e2de3f36d3 [Doc] Add English version of some documents (#1221) 
* Update README_CN.md

* Create README.md

* Update README.md

* Create README_CN.md

* Update README.md

* Update README_CN.md

* Update README_CN.md

* Create README.md

* Update README.md

* Update README_CN.md

* Create README.md

* Update README.md

* Update README_CN.md

* Rename examples/vision/faceid/insightface/rknpu2/cpp/README.md to examples/vision/faceid/insightface/rknpu2/README_EN.md

* Rename README_CN.md to README.md

* Rename README.md to README_EN.md

* Rename README.md to README_CN.md

* Rename README_EN.md to README.md

* Create build.md

* Create environment.md

* Create issues.md

* Update build.md

* Update environment.md

* Update issues.md

* Update build.md

* Update environment.md

* Update issues.md
 2023-02-06 11:11:00 +08:00
WJJ1995
cfc7af2d45 [Benchmark] avoid Result mem copy for cpp benchmark (#1203) 
* avoid mem copy for cpp benchmark

* set CMAKE_BUILD_TYPE to Release
 2023-02-06 10:19:44 +08:00
yunyaoXYY
870551f3f5 [Docs] Improve docs related to Ascend inference (#1227) 
* Add Readme for vision results

* Add Readme for vision results

* Add Readme for vision results

* Add Readme for vision results

* Add Readme for vision results

* Add Readme for vision results

* Add Readme for vision results

* Add Readme for vision results

* Add Readme for vision results

* Add Readme for vision results

* Add comments to create API docs

* Improve OCR comments

* fix conflict

* Fix OCR Readme

* Fix PPOCR readme

* Fix PPOCR readme

* fix conflict

* Improve ascend readme

* Improve ascend readme

* Improve ascend readme

* Improve ascend readme
 2023-02-04 17:03:03 +08:00
leiqing
522e96bce8 Update README_CN.md 2023-02-03 21:34:49 +08:00