apps/FastDeploy
1
0
Fork 0
mirror of https://github.com/PaddlePaddle/FastDeploy.git synced 2025-12-24 13:28:13 +08:00
Code Issues Actions 2 Packages Projects Releases Wiki Activity
2,091 Commits 29 Branches 10 Tags
25eae73534fe1a549ab4e6f6f8d166faa159ce5b
Commit Graph

2091 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
yunyaoXYY
25eae73534 Merge branch 'develop' of https://github.com/PaddlePaddle/FastDeploy into new_dev 2023-02-27 08:30:38 +00:00
DefTruth
7e5e690367 [Model] Add skip valid backend check option -> FastDeployModel (#1445) 
* [Model] Add skip valid backend check option -> FastDeployModel

* [Model] Add skip valid backend check option -> FastDeployModel

* [Model] Add skip valid backend check option -> FastDeployModel
 2023-02-27 15:37:01 +08:00
chenjian
6f8d4d14c2 [Doc] add docs for how to develop c api (#1385) 
* add docs for how to develop c api

* add English doc for developing C API

* fix api doc

* add index
 2023-02-27 15:09:51 +08:00
Zheng-Bicheng
8c3ccc2cc2 [Hackathon 182 Model] Update PPOCRV3 For RKNPU2 (#1403) 
* update ppocrv3 for rknpu2

* add config

* add config

* detele unuseful

* update useful results

* Repair note

* Repair note

* fixed bugs

* update
 2023-02-27 15:01:17 +08:00
chenjian
b6e8773b2f [C API] add ppseg c api (#1384) 
* add ppseg c api

* fix bug

* fix interface
 2023-02-27 11:07:56 +08:00
Wang Xinyu
017f305632 [Serving] Compile on CentOS without docker tutorial (#1440) 
serving compile doc
 2023-02-27 11:02:39 +08:00
Zeref996
be313a859b fix serving/Dockerfile (#1397) 
* fix serving/Dockerfile

* fix download paddlepaddle
 2023-02-27 10:32:28 +08:00
heliqi
fc37b8dd49 [Serving]Update compile.md (#1433) 
* Update compile.md

* Update compile-en.md
 2023-02-27 09:42:03 +08:00
Zheng-Bicheng
88c4f075e2 [Bug Fix] Fix the error when tinypose uses python under rknpu (#1437) 
fixed bug
 2023-02-27 09:41:13 +08:00
Zheng-Bicheng
8e50fa307c [Bug Fix] Fixed the segment error during the visualization of the detection model (#1420) 
fixed detection bug
 2023-02-25 12:49:38 +08:00
DefTruth
226cdda1df [benchmark] Update benchmark cpp CMakeLists.txt (#1432) 
Update benchmark cpp CMakeLists.txt
 2023-02-24 11:51:19 +08:00
yunyaoXYY
df79c58814 [Doc] Improve PPOCR API docs. (#1428) 
* Add Huawei Ascend NPU deploy through PaddleLite CANN

* Add NNAdapter interface for paddlelite

* Modify Huawei Ascend Cmake

* Update way for compiling Huawei Ascend NPU deployment

* remove UseLiteBackend in UseCANN

* Support compile python whlee

* Change names of nnadapter API

* Add nnadapter pybind and remove useless API

* Support Python deployment on Huawei Ascend NPU

* Fix links in readme

* Fix links in readme

* Update PPOCRv2/v3 examples

* Update auto compression configs

* Add neww quantization  support for paddleclas model

* Update quantized Yolov6s model download link

* Improve PPOCR comments

* Add models suppor for ascend

* Add PPOCR rec reszie for ascend

* fix conflict for ascend

* Rename CANN to Ascend

* Rename CANN to Ascend

* Improve ascend

* fix ascend bug

* improve ascend docs

* improve ascend docs

* improve ascend docs

* Add English doc for quantization

* Improve Ascend

* Improve Ascend

* Move ascend python demo

* Imporve ascend

* Fix PPOCR rec model bug

* Improve ascend

* Improve ascend

* Improve ascend

* Improve ascend

* Add  new paddleseg quantization support

* Add  new paddleseg quantization support

* Add  new paddleseg quantization support

* Add  new paddleseg quantization support

* Imporve ascend

* Imporve ascend

* Improve ascend

* acc eval script

* acc eval

* remove acc_eval from branch huawei

* Add detection and segmentation examples for Ascend deployment

* Add detection and segmentation examples for Ascend deployment

* Add Ascend model list

* Add ascend model list

* Add ascend model list

* Add ascend model list

* Add ascend model list

* Add ascend model list

* Add ascend model list

* Add PPOCR example for ascend deploy

* Imporve paddle lite compiliation

* Add FlyCV doc

* Add FlyCV doc

* Add FlyCV doc

* Imporve Ascend docs

* Imporve Ascend docs

* Improve PPOCR example

* Support Ascend deployment on X86 platform

* Improve Ascend docs

* Improve ascend

* Improve ascend

* Change Paddle Lite Ascend URL

* fix ascend docs

* fix ascend docs

* Fix Paddle Lite Ascend Lib

* Imporve compile of Ascend

* Imporve compile of Ascend

* fix paddle lite compile

* Remove useless opencv code for ocr

* Improve PPOCR API docs

* Improve PPOCR API docs

* Improve PPOCR API docs
 2023-02-24 09:45:39 +08:00
Jack Zhou
524c85745b [Backend] Add fixed size optimization for transformer model (#1430) 
Add enable_fixed_size_opt flag
 2023-02-24 09:45:04 +08:00
yunyaoXYY
8c3046fe17 Improve PPOCR API docs 2023-02-23 11:38:07 +00:00
yunyaoXYY
e27a5c8e70 Improve PPOCR API docs 2023-02-23 11:30:45 +00:00
yunyaoXYY
7447e4bb37 Improve PPOCR API docs 2023-02-23 11:25:22 +00:00
yunyaoXYY
5a2f286675 Improve PPOCR API docs 2023-02-23 11:23:41 +00:00
WJJ1995
d3845eb4e1 [Benchmark]Compare diff for OCR (#1415) 
* avoid mem copy for cpp benchmark

* set CMAKE_BUILD_TYPE to Release

* Add SegmentationDiff

* change pointer to reference

* fixed bug

* cast uint8 to int32

* Add diff compare for OCR

* Add diff compare for OCR

* rm ppocr pipeline

* Add yolov5 diff compare

* Add yolov5 diff compare

* deal with comments

* deal with comments

* fixed bug

* fixed bug
 2023-02-23 18:57:39 +08:00
Jason
0c664fd006 [Other] Fix some memory leak problem (#1422) 
* Fix memory leak problem for paddleseg model

* Fix bug

* Update postprocessor.cc

---------

Co-authored-by: root <root@bjyz-sys-gpu-kongming3.bjyz.baidu.com>
 2023-02-23 16:03:40 +08:00
Zeref996
a1f9aa1c5a refresh docker compile doc (#1423) 
* refresh docker compile doc

* refresh docker compile doc 1
 2023-02-23 14:59:50 +08:00
Zeref996
51318388ae Merge pull request #1408 from Zeref996/refresh-version-doc-104 
refreash version 1.0.4 doc
 2023-02-23 14:40:13 +08:00
Jason
062b4fd327 [Bug Fix] Fix memory leak problem for paddleseg model (#1421) 
Fix memory leak problem for paddleseg model

Co-authored-by: root <root@bjyz-sys-gpu-kongming3.bjyz.baidu.com>
 2023-02-23 12:45:25 +08:00
Jack Zhou
9689bf5fce Merge pull request #1409 from joey12300/fix_trt_version_bug 
[Serving] Fix trt version bug
 2023-02-22 20:05:15 +08:00
Wang Xinyu
91a1c72f98 [CVCUDA] PP-OCR detector preprocessor integrate CV-CUDA (#1382) 
* move manager initialized_ flag to ppcls

* update dbdetector preprocess api

* declare processor op

* ppocr detector preprocessor support cvcuda

* move cvcuda op to class member

* ppcls use manager register api

* refactor det preprocessor init api

* add set preprocessor api

* add create processor macro

* new processor call api

* ppcls preprocessor init resize on cpu

* ppocr detector preprocessor set normalize api

* revert ppcls pybind

* remove dbdetector set preprocessor

* refine dbdetector preprocessor includes

* remove mean std in py constructor

* add comments

* update comment

* Update __init__.py
 2023-02-22 19:39:11 +08:00
zhoushunjie
1b1f68499e fix trt version bug 2023-02-22 08:37:25 +00:00
Zeref996
b6349d5d1d refreash version 1.0.4 doc 2023-02-22 14:45:42 +08:00
WJJ1995
2f8d9c9a57 [Benchmark]Add SegmentationDiff to compare SegmentationResult diff (#1404) 
* avoid mem copy for cpp benchmark

* set CMAKE_BUILD_TYPE to Release

* Add SegmentationDiff

* change pointer to reference

* fixed bug

* cast uint8 to int32
 2023-02-22 14:42:21 +08:00
Jason
dd527388bc Update option.h 2023-02-22 11:28:04 +08:00
Jason
cc9031c17e Update README.md 2023-02-21 20:49:13 +08:00
WJJ1995
721e6efb81 [Benchmark] Add ClassifyDiff to compare ClassifyResult diff (#1381) 
* add GPL lisence

* add GPL-3.0 lisence

* add GPL-3.0 lisence

* add GPL-3.0 lisence

* support yolov8

* add pybind for yolov8

* add yolov8 readme

* add cpp benchmark

* add cpu and gpu mem

* public part split

* add runtime mode

* fixed bugs

* add cpu_thread_nums

* deal with comments

* deal with comments

* deal with comments

* rm useless code

* add FASTDEPLOY_DECL

* add FASTDEPLOY_DECL

* fixed for windows

* mv rss to pss

* mv rss to pss

* Update utils.cc

* use thread to collect mem

* Add ResourceUsageMonitor

* rm useless code

* fixed bug

* fixed typo

* update ResourceUsageMonitor

* fixed bug

* fixed bug

* add note for ResourceUsageMonitor

* deal with comments

* add macros

* deal with comments

* deal with comments

* deal with comments

* re-lint

* rm pmap and use mem api

* rm pmap and use mem api

* add mem api

* Add PrintBenchmarkInfo func

* Add PrintBenchmarkInfo func

* Add PrintBenchmarkInfo func

* deal with comments

* fixed enable_paddle_to_trt

* add log for paddle_trt

* support ppcls benchmark

* use new trt option api

* update benchmark info

* simplify benchmark.cc

* simplify benchmark.cc

* deal with comments

* Add ppseg && ppocr benchmark

* add OCR rec img

* add ocr benchmark

* fixed trt shape

* add trt shape

* resolve conflict

* add ENABLE_BENCHMARK define

* Add ClassifyDiff

* Add Resize for ClassifyResult

* deal with comments

---------

Co-authored-by: DefTruth <31974251+DefTruth@users.noreply.github.com>
 2023-02-21 18:01:13 +08:00
Jason
18e33bae5c [Other] Optimize runtime module (#1356) 
* Optimize runtime

* fix error

* [Backend] Add option to print tensorrt conversion log (#1386)

Add option to print tensorrt conversion log

Co-authored-by: root <root@bjyz-sys-gpu-kongming3.bjyz.baidu.com>

---------

Co-authored-by: root <root@bjyz-sys-gpu-kongming3.bjyz.baidu.com>
 2023-02-21 17:01:32 +08:00
DefTruth
42817ddc18 [Doc] Update cpp benchmark docs for CPU/GPU (#1377) 
* [Benchmark] Init benchmark precision api

* [Benchmark] Init benchmark precision api

* [Benchmark] Add benchmark precision api

* [Benchmark] Calculate the statis of diff

* [Benchmark] Calculate the statis of diff

* [Benchmark] Calculate the statis of diff

* [Benchmark] Calculate the statis of diff

* [Benchmark] Calculate the statis of diff

* [Benchmark] Add SplitDataLine utils

* [Benchmark] Add LexSortByXY func

* [Benchmark] Add LexSortByXY func

* [Benchmark] Add LexSortDetectionResultByXY func

* [Benchmark] Add LexSortDetectionResultByXY func

* [Benchmark] Add tensor diff presicion test

* [Benchmark] fixed conflicts

* [Benchmark] fixed calc tensor diff

* fixed build bugs

* fixed ci bugs when WITH_TESTING=ON

* [Docs] init cpp benchmark docs

* [Doc] update cpp benchmark docs

* [Doc] update cpp benchmark docs

* [Doc] update cpp  benchmark docs

* [Doc] update cpp  benchmark docs
 2023-02-21 15:41:37 +08:00
TianShaoqing
5f8157c398 update poros README.md (#1393) 
Co-authored-by: tianshaoqing <tianshaoqing@baidu.com>
 2023-02-21 13:35:30 +08:00
TianShaoqing
5e77e4057d Merge pull request #1387 from TianShaoqing/develop 
[Backend] update poros
 2023-02-21 10:35:39 +08:00
tianshaoqing
f212f5c592 [Backend] update poros 2023-02-20 21:49:58 +08:00
huangjianhui
08aa209ea4 [Doc] Fix wrong word (#1380) 
* Update README_CN.md

Wrong word

* Update README_EN.md

Wrong word
 2023-02-20 19:44:51 +08:00
Jason
c3aee4f7f0 [Doc] Add cmake version notice in Jetson doc (#1379) 
* Update jetson.md

* Update jetson.md
 2023-02-20 18:52:50 +08:00
yunyaoXYY
7dc15e4a77 [Other] Remove useless OpenCV usage for PP-OCR. (#1375) 
* Add Huawei Ascend NPU deploy through PaddleLite CANN

* Add NNAdapter interface for paddlelite

* Modify Huawei Ascend Cmake

* Update way for compiling Huawei Ascend NPU deployment

* remove UseLiteBackend in UseCANN

* Support compile python whlee

* Change names of nnadapter API

* Add nnadapter pybind and remove useless API

* Support Python deployment on Huawei Ascend NPU

* Fix links in readme

* Fix links in readme

* Update PPOCRv2/v3 examples

* Update auto compression configs

* Add neww quantization  support for paddleclas model

* Update quantized Yolov6s model download link

* Improve PPOCR comments

* Add models suppor for ascend

* Add PPOCR rec reszie for ascend

* fix conflict for ascend

* Rename CANN to Ascend

* Rename CANN to Ascend

* Improve ascend

* fix ascend bug

* improve ascend docs

* improve ascend docs

* improve ascend docs

* Add English doc for quantization

* Improve Ascend

* Improve Ascend

* Move ascend python demo

* Imporve ascend

* Fix PPOCR rec model bug

* Improve ascend

* Improve ascend

* Improve ascend

* Improve ascend

* Add  new paddleseg quantization support

* Add  new paddleseg quantization support

* Add  new paddleseg quantization support

* Add  new paddleseg quantization support

* Imporve ascend

* Imporve ascend

* Improve ascend

* acc eval script

* acc eval

* remove acc_eval from branch huawei

* Add detection and segmentation examples for Ascend deployment

* Add detection and segmentation examples for Ascend deployment

* Add Ascend model list

* Add ascend model list

* Add ascend model list

* Add ascend model list

* Add ascend model list

* Add ascend model list

* Add ascend model list

* Add PPOCR example for ascend deploy

* Imporve paddle lite compiliation

* Add FlyCV doc

* Add FlyCV doc

* Add FlyCV doc

* Imporve Ascend docs

* Imporve Ascend docs

* Improve PPOCR example

* Support Ascend deployment on X86 platform

* Improve Ascend docs

* Improve ascend

* Improve ascend

* Change Paddle Lite Ascend URL

* fix ascend docs

* fix ascend docs

* Fix Paddle Lite Ascend Lib

* Imporve compile of Ascend

* Imporve compile of Ascend

* fix paddle lite compile

* Remove useless opencv code for ocr
 2023-02-20 18:32:49 +08:00
Zheng-Bicheng
9593c15ad8 [Doc]Rknn docs (#1376) 
* 按照要求更新

* update rknn docs
 2023-02-20 18:19:11 +08:00
Jason
dc5b4be7a9 [Other] Enable to hidden INFO/WARNING log informations (#1368) 
* Enable to hidden INFO/WARNING log informations

* Fix build error

---------

Co-authored-by: root <root@bjyz-sys-gpu-kongming3.bjyz.baidu.com>
 2023-02-20 17:24:12 +08:00
yunyaoXYY
cbe7066afe Merge branch 'develop' of https://github.com/PaddlePaddle/FastDeploy into new_dev 2023-02-20 09:02:12 +00:00
WJJ1995
b6658b8094 [Benchmark] Add ppocr && ppseg benchmark (#1344) 
* add GPL lisence

* add GPL-3.0 lisence

* add GPL-3.0 lisence

* add GPL-3.0 lisence

* support yolov8

* add pybind for yolov8

* add yolov8 readme

* add cpp benchmark

* add cpu and gpu mem

* public part split

* add runtime mode

* fixed bugs

* add cpu_thread_nums

* deal with comments

* deal with comments

* deal with comments

* rm useless code

* add FASTDEPLOY_DECL

* add FASTDEPLOY_DECL

* fixed for windows

* mv rss to pss

* mv rss to pss

* Update utils.cc

* use thread to collect mem

* Add ResourceUsageMonitor

* rm useless code

* fixed bug

* fixed typo

* update ResourceUsageMonitor

* fixed bug

* fixed bug

* add note for ResourceUsageMonitor

* deal with comments

* add macros

* deal with comments

* deal with comments

* deal with comments

* re-lint

* rm pmap and use mem api

* rm pmap and use mem api

* add mem api

* Add PrintBenchmarkInfo func

* Add PrintBenchmarkInfo func

* Add PrintBenchmarkInfo func

* deal with comments

* fixed enable_paddle_to_trt

* add log for paddle_trt

* support ppcls benchmark

* use new trt option api

* update benchmark info

* simplify benchmark.cc

* simplify benchmark.cc

* deal with comments

* Add ppseg && ppocr benchmark

* add OCR rec img

* add ocr benchmark

* fixed trt shape

* add trt shape

* resolve conflict

* add ENABLE_BENCHMARK define

---------

Co-authored-by: DefTruth <31974251+DefTruth@users.noreply.github.com>
 2023-02-20 15:59:27 +08:00
Jack Zhou
1b499f3de2 [Serving] Update serving build script (#1371) 
Update serving build script
 2023-02-20 15:30:49 +08:00
yunyaoXYY
b2e13db58f Merge branch 'develop' of https://github.com/PaddlePaddle/FastDeploy into new_dev 2023-02-20 06:50:50 +00:00
yunyaoXYY
0b5a8aeb23 Remove useless opencv code for ocr 2023-02-20 06:50:35 +00:00
DefTruth
95f809c1ff [Bug Fix] fix build error while enable flycv on linux x64 (#1365) 
* [Bug Fix] fix build error while enable flycv on linux x64

* [Bug Fix] fix build error while enable flycv on linux x64

* move WITH_FLYCV_STATIC option -> flycv.cmake
 2023-02-20 13:52:31 +08:00
chenjian
9b482b72fb fix demo code (#1355) 2023-02-17 16:03:37 +08:00
chenjian
859896cd2c [Other] add code and docs for ppclas examples (#1312) 
* add code and docs for ppclas examples

* fix doc

* add code for printing results

* add ppcls demo and docs

* modify example according to refined c api

* modify example code and docs for ppcls and ppdet

* modify example code and docs for ppcls and ppdet

* update ppdet demo

* fix demo codes

* fix doc

* release resource when failed

* fix

* fix name

* fix name
 2023-02-17 15:43:21 +08:00
chenjian
7c4e0d7ba0 [C API] Add c apis for ppocr models (#1351) 
* add batch_predict and initialized api for c

* add batch_predict and result str in C api

* modify visualization function

* add micro to add models batchify

* refactor and add models for ppdet others

* add base define

* add results api

* add headers

* add ppocr models

* add codes for implementing api

* add code

* add ppocr apis

* fix code

* add codes

* fix codes

* add demo
 2023-02-17 15:43:12 +08:00
heliqi
8f21d55e5c [Serving]support encryt (#1349) 
* serving support encryt

* Update fastdeploy_runtime.cc
 2023-02-17 15:29:57 +08:00