Commit Graph

2258 Commits

Author SHA1 Message Date
chenjian
586684daa9 [C API] Add c api for yolo serial models (#1418)
* add c api for yolo serial models

* fix bug

* update batch predict func

* fix

* update code

* split code
2023-02-28 17:49:33 +08:00
lishicheng1996
b324f3659b [Other] Integrate paddle2coreml tool into FastDeploy (#1460)
Integration of paddle2coreml tool
2023-02-28 16:22:05 +08:00
yunyaoXYY
1f35685b45 Merge branch 'develop' of https://github.com/yunyaoXYY/FastDeploy into develop 2023-02-28 08:03:27 +00:00
yunyaoXYY
803521002f Merge branch 'develop' of https://github.com/PaddlePaddle/FastDeploy into develop 2023-02-28 08:01:36 +00:00
yunyaoXYY
d09fbd861e Improve interface 2023-02-28 07:51:22 +00:00
WJJ1995
fe9aff15f2 [Benchmark] Add SaveBenchmarkResult func for benchmark (#1442)
* add GPL lisence

* add GPL-3.0 lisence

* add GPL-3.0 lisence

* add GPL-3.0 lisence

* support yolov8

* add pybind for yolov8

* add yolov8 readme

* add cpp benchmark

* add cpu and gpu mem

* public part split

* add runtime mode

* fixed bugs

* add cpu_thread_nums

* deal with comments

* deal with comments

* deal with comments

* rm useless code

* add FASTDEPLOY_DECL

* add FASTDEPLOY_DECL

* fixed for windows

* mv rss to pss

* mv rss to pss

* Update utils.cc

* use thread to collect mem

* Add ResourceUsageMonitor

* rm useless code

* fixed bug

* fixed typo

* update ResourceUsageMonitor

* fixed bug

* fixed bug

* add note for ResourceUsageMonitor

* deal with comments

* add macros

* deal with comments

* deal with comments

* deal with comments

* re-lint

* rm pmap and use mem api

* rm pmap and use mem api

* add mem api

* Add PrintBenchmarkInfo func

* Add PrintBenchmarkInfo func

* Add PrintBenchmarkInfo func

* deal with comments

* fixed enable_paddle_to_trt

* add log for paddle_trt

* support ppcls benchmark

* use new trt option api

* update benchmark info

* simplify benchmark.cc

* simplify benchmark.cc

* deal with comments

* Add ppseg && ppocr benchmark

* add OCR rec img

* add ocr benchmark

* fixed trt shape

* add trt shape

* resolve conflict

* add ENABLE_BENCHMARK define

* Add ClassifyDiff

* Add Resize for ClassifyResult

* deal with comments

* add convert info script

* resolve conflict

* Add SaveBenchmarkResult func

* fixed bug

* fixed bug

* fixed bug

---------

Co-authored-by: DefTruth <31974251+DefTruth@users.noreply.github.com>
2023-02-28 11:55:22 +08:00
Jack Zhou
0e67d95d57 [Other] Fix order of paddle and fastdeploy (#1451)
* Fix order of paddle and fastdeploy

* update comment
2023-02-28 09:58:19 +08:00
DefTruth
e86905ca0d [Bug Fix] move enable_valid_backend_check option -> runtime_option (#1450)
* [Model] Add skip valid backend check option -> FastDeployModel

* [Model] Add skip valid backend check option -> FastDeployModel

* [Model] Add skip valid backend check option -> FastDeployModel

* [FastDeploy] move enable_valid_backend_check option -> runtime_option
2023-02-28 09:57:31 +08:00
Hui Zhang
08fa69352e remove CMAKE_CXX_STANDARD 11 for conflict (#1456) 2023-02-28 09:54:17 +08:00
Jason
ae254c60f4 Update README_CN.md 2023-02-27 21:36:12 +08:00
Jason
a154644b21 Update README.md 2023-02-27 21:34:54 +08:00
Jason
763af6aa8e Update README.md 2023-02-27 21:33:51 +08:00
chenjian
16c48203e3 [Doc] Add readme for C and C# directory (#1452)
add docs
2023-02-27 21:02:57 +08:00
chenjian
266ae046f2 [C API] Refactor code structure (#1449)
* refactor code

* move files

* fix doc

* fix
2023-02-27 20:19:13 +08:00
chenjian
48f776b9db [C#] Add c# api for ppseg models (#1398)
* add c# api for ppseg

* add example

* fix according to test

* update interface

* fix destroy funcs
2023-02-27 20:16:17 +08:00
yunyaoXYY
444f328ba4 Improve det_model pybind 2023-02-27 08:32:53 +00:00
yunyaoXYY
25eae73534 Merge branch 'develop' of https://github.com/PaddlePaddle/FastDeploy into new_dev 2023-02-27 08:30:38 +00:00
DefTruth
7e5e690367 [Model] Add skip valid backend check option -> FastDeployModel (#1445)
* [Model] Add skip valid backend check option -> FastDeployModel

* [Model] Add skip valid backend check option -> FastDeployModel

* [Model] Add skip valid backend check option -> FastDeployModel
2023-02-27 15:37:01 +08:00
chenjian
6f8d4d14c2 [Doc] add docs for how to develop c api (#1385)
* add docs for how to develop c api

* add English doc for developing C API

* fix api doc

* add index
2023-02-27 15:09:51 +08:00
Zheng-Bicheng
8c3ccc2cc2 [Hackathon 182 Model] Update PPOCRV3 For RKNPU2 (#1403)
* update ppocrv3 for rknpu2

* add config

* add config

* detele unuseful

* update useful results

* Repair note

* Repair note

* fixed bugs

* update
2023-02-27 15:01:17 +08:00
chenjian
b6e8773b2f [C API] add ppseg c api (#1384)
* add ppseg c api

* fix bug

* fix interface
2023-02-27 11:07:56 +08:00
Wang Xinyu
017f305632 [Serving] Compile on CentOS without docker tutorial (#1440)
serving compile doc
2023-02-27 11:02:39 +08:00
Zeref996
be313a859b fix serving/Dockerfile (#1397)
* fix serving/Dockerfile

* fix download paddlepaddle
2023-02-27 10:32:28 +08:00
heliqi
fc37b8dd49 [Serving]Update compile.md (#1433)
* Update compile.md

* Update compile-en.md
2023-02-27 09:42:03 +08:00
Zheng-Bicheng
88c4f075e2 [Bug Fix] Fix the error when tinypose uses python under rknpu (#1437)
fixed bug
2023-02-27 09:41:13 +08:00
Zheng-Bicheng
8e50fa307c [Bug Fix] Fixed the segment error during the visualization of the detection model (#1420)
fixed detection bug
2023-02-25 12:49:38 +08:00
DefTruth
226cdda1df [benchmark] Update benchmark cpp CMakeLists.txt (#1432)
Update benchmark cpp CMakeLists.txt
2023-02-24 11:51:19 +08:00
yunyaoXYY
df79c58814 [Doc] Improve PPOCR API docs. (#1428)
* Add Huawei Ascend NPU deploy through PaddleLite CANN

* Add NNAdapter interface for paddlelite

* Modify Huawei Ascend Cmake

* Update way for compiling Huawei Ascend NPU deployment

* remove UseLiteBackend in UseCANN

* Support compile python whlee

* Change names of nnadapter API

* Add nnadapter pybind and remove useless API

* Support Python deployment on Huawei Ascend NPU

* Fix links in readme

* Fix links in readme

* Update PPOCRv2/v3 examples

* Update auto compression configs

* Add neww quantization  support for paddleclas model

* Update quantized Yolov6s model download link

* Improve PPOCR comments

* Add models suppor for ascend

* Add PPOCR rec reszie for ascend

* fix conflict for ascend

* Rename CANN to Ascend

* Rename CANN to Ascend

* Improve ascend

* fix ascend bug

* improve ascend docs

* improve ascend docs

* improve ascend docs

* Add English doc for quantization

* Improve Ascend

* Improve Ascend

* Move ascend python demo

* Imporve ascend

* Fix PPOCR rec model bug

* Improve ascend

* Improve ascend

* Improve ascend

* Improve ascend

* Add  new paddleseg quantization support

* Add  new paddleseg quantization support

* Add  new paddleseg quantization support

* Add  new paddleseg quantization support

* Imporve ascend

* Imporve ascend

* Improve ascend

* acc eval script

* acc eval

* remove acc_eval from branch huawei

* Add detection and segmentation examples for Ascend deployment

* Add detection and segmentation examples for Ascend deployment

* Add Ascend model list

* Add ascend model list

* Add ascend model list

* Add ascend model list

* Add ascend model list

* Add ascend model list

* Add ascend model list

* Add PPOCR example for ascend deploy

* Imporve paddle lite compiliation

* Add FlyCV doc

* Add FlyCV doc

* Add FlyCV doc

* Imporve Ascend docs

* Imporve Ascend docs

* Improve PPOCR example

* Support Ascend deployment on X86 platform

* Improve Ascend docs

* Improve ascend

* Improve ascend

* Change Paddle Lite Ascend URL

* fix ascend docs

* fix ascend docs

* Fix Paddle Lite Ascend Lib

* Imporve compile of Ascend

* Imporve compile of Ascend

* fix paddle lite compile

* Remove useless opencv code for ocr

* Improve PPOCR API docs

* Improve PPOCR API docs

* Improve PPOCR API docs
2023-02-24 09:45:39 +08:00
Jack Zhou
524c85745b [Backend] Add fixed size optimization for transformer model (#1430)
Add enable_fixed_size_opt flag
2023-02-24 09:45:04 +08:00
yunyaoXYY
8c3046fe17 Improve PPOCR API docs 2023-02-23 11:38:07 +00:00
yunyaoXYY
e27a5c8e70 Improve PPOCR API docs 2023-02-23 11:30:45 +00:00
yunyaoXYY
7447e4bb37 Improve PPOCR API docs 2023-02-23 11:25:22 +00:00
yunyaoXYY
5a2f286675 Improve PPOCR API docs 2023-02-23 11:23:41 +00:00
WJJ1995
d3845eb4e1 [Benchmark]Compare diff for OCR (#1415)
* avoid mem copy for cpp benchmark

* set CMAKE_BUILD_TYPE to Release

* Add SegmentationDiff

* change pointer to reference

* fixed bug

* cast uint8 to int32

* Add diff compare for OCR

* Add diff compare for OCR

* rm ppocr pipeline

* Add yolov5 diff compare

* Add yolov5 diff compare

* deal with comments

* deal with comments

* fixed bug

* fixed bug
2023-02-23 18:57:39 +08:00
Jason
0c664fd006 [Other] Fix some memory leak problem (#1422)
* Fix memory leak problem for paddleseg model

* Fix bug

* Update postprocessor.cc

---------

Co-authored-by: root <root@bjyz-sys-gpu-kongming3.bjyz.baidu.com>
2023-02-23 16:03:40 +08:00
Zeref996
a1f9aa1c5a refresh docker compile doc (#1423)
* refresh docker compile doc

* refresh docker compile doc 1
2023-02-23 14:59:50 +08:00
Zeref996
51318388ae Merge pull request #1408 from Zeref996/refresh-version-doc-104
refreash version 1.0.4 doc
2023-02-23 14:40:13 +08:00
Jason
062b4fd327 [Bug Fix] Fix memory leak problem for paddleseg model (#1421)
Fix memory leak problem for paddleseg model

Co-authored-by: root <root@bjyz-sys-gpu-kongming3.bjyz.baidu.com>
2023-02-23 12:45:25 +08:00
Jack Zhou
9689bf5fce Merge pull request #1409 from joey12300/fix_trt_version_bug
[Serving] Fix trt version bug
2023-02-22 20:05:15 +08:00
Wang Xinyu
91a1c72f98 [CVCUDA] PP-OCR detector preprocessor integrate CV-CUDA (#1382)
* move manager initialized_ flag to ppcls

* update dbdetector preprocess api

* declare processor op

* ppocr detector preprocessor support cvcuda

* move cvcuda op to class member

* ppcls use manager register api

* refactor det preprocessor init api

* add set preprocessor api

* add create processor macro

* new processor call api

* ppcls preprocessor init resize on cpu

* ppocr detector preprocessor set normalize api

* revert ppcls pybind

* remove dbdetector set preprocessor

* refine dbdetector preprocessor includes

* remove mean std in py constructor

* add comments

* update comment

* Update __init__.py
2023-02-22 19:39:11 +08:00
zhoushunjie
1b1f68499e fix trt version bug 2023-02-22 08:37:25 +00:00
Zeref996
b6349d5d1d refreash version 1.0.4 doc 2023-02-22 14:45:42 +08:00
WJJ1995
2f8d9c9a57 [Benchmark]Add SegmentationDiff to compare SegmentationResult diff (#1404)
* avoid mem copy for cpp benchmark

* set CMAKE_BUILD_TYPE to Release

* Add SegmentationDiff

* change pointer to reference

* fixed bug

* cast uint8 to int32
2023-02-22 14:42:21 +08:00
Jason
dd527388bc Update option.h 2023-02-22 11:28:04 +08:00
Jason
cc9031c17e Update README.md 2023-02-21 20:49:13 +08:00
WJJ1995
721e6efb81 [Benchmark] Add ClassifyDiff to compare ClassifyResult diff (#1381)
* add GPL lisence

* add GPL-3.0 lisence

* add GPL-3.0 lisence

* add GPL-3.0 lisence

* support yolov8

* add pybind for yolov8

* add yolov8 readme

* add cpp benchmark

* add cpu and gpu mem

* public part split

* add runtime mode

* fixed bugs

* add cpu_thread_nums

* deal with comments

* deal with comments

* deal with comments

* rm useless code

* add FASTDEPLOY_DECL

* add FASTDEPLOY_DECL

* fixed for windows

* mv rss to pss

* mv rss to pss

* Update utils.cc

* use thread to collect mem

* Add ResourceUsageMonitor

* rm useless code

* fixed bug

* fixed typo

* update ResourceUsageMonitor

* fixed bug

* fixed bug

* add note for ResourceUsageMonitor

* deal with comments

* add macros

* deal with comments

* deal with comments

* deal with comments

* re-lint

* rm pmap and use mem api

* rm pmap and use mem api

* add mem api

* Add PrintBenchmarkInfo func

* Add PrintBenchmarkInfo func

* Add PrintBenchmarkInfo func

* deal with comments

* fixed enable_paddle_to_trt

* add log for paddle_trt

* support ppcls benchmark

* use new trt option api

* update benchmark info

* simplify benchmark.cc

* simplify benchmark.cc

* deal with comments

* Add ppseg && ppocr benchmark

* add OCR rec img

* add ocr benchmark

* fixed trt shape

* add trt shape

* resolve conflict

* add ENABLE_BENCHMARK define

* Add ClassifyDiff

* Add Resize for ClassifyResult

* deal with comments

---------

Co-authored-by: DefTruth <31974251+DefTruth@users.noreply.github.com>
2023-02-21 18:01:13 +08:00
Jason
18e33bae5c [Other] Optimize runtime module (#1356)
* Optimize runtime

* fix error

* [Backend] Add option to print tensorrt conversion log (#1386)

Add option to print tensorrt conversion log

Co-authored-by: root <root@bjyz-sys-gpu-kongming3.bjyz.baidu.com>

---------

Co-authored-by: root <root@bjyz-sys-gpu-kongming3.bjyz.baidu.com>
2023-02-21 17:01:32 +08:00
DefTruth
42817ddc18 [Doc] Update cpp benchmark docs for CPU/GPU (#1377)
* [Benchmark] Init benchmark precision api

* [Benchmark] Init benchmark precision api

* [Benchmark] Add benchmark precision api

* [Benchmark] Calculate the statis of diff

* [Benchmark] Calculate the statis of diff

* [Benchmark] Calculate the statis of diff

* [Benchmark] Calculate the statis of diff

* [Benchmark] Calculate the statis of diff

* [Benchmark] Add SplitDataLine utils

* [Benchmark] Add LexSortByXY func

* [Benchmark] Add LexSortByXY func

* [Benchmark] Add LexSortDetectionResultByXY func

* [Benchmark] Add LexSortDetectionResultByXY func

* [Benchmark] Add tensor diff presicion test

* [Benchmark] fixed conflicts

* [Benchmark] fixed calc tensor diff

* fixed build bugs

* fixed ci bugs when WITH_TESTING=ON

* [Docs] init cpp benchmark docs

* [Doc] update cpp benchmark docs

* [Doc] update cpp benchmark docs

* [Doc] update cpp  benchmark docs

* [Doc] update cpp  benchmark docs
2023-02-21 15:41:37 +08:00
TianShaoqing
5f8157c398 update poros README.md (#1393)
Co-authored-by: tianshaoqing <tianshaoqing@baidu.com>
2023-02-21 13:35:30 +08:00
TianShaoqing
5e77e4057d Merge pull request #1387 from TianShaoqing/develop
[Backend] update poros
2023-02-21 10:35:39 +08:00