Commit Graph

192 Commits

Author SHA1 Message Date
guxukai
ed19c759df [CVCUDA] Add CV-CUDA support in PaddleSeg (#1761)
* add cvcuda support in ppseg

* python and pybind

* add resize op, remove concat,std::move

* define resize op
2023-04-09 10:38:18 +08:00
Zheng-Bicheng
109d1046ae [Model] add function for setting anchor rknpu2 (#1728)
* add function for setting anchor rknpu2
add more demo for rknpu2
fixed md error

* Update config.h

---------

Co-authored-by: DefTruth <31974251+DefTruth@users.noreply.github.com>
2023-04-04 20:33:06 +08:00
guxukai
38f056d1c1 [CVCUDA] PP-OCR and PPDet preprocessor support use_cuda python API(#1734)
add cvcuda support in ppocr and ppdet
2023-03-29 20:57:36 +08:00
Jason
7507003113 Update __init__.py 2023-03-29 12:57:40 +08:00
guxukai
0343deb328 [Doc] add vision processor python api doc (#1655)
* add vision processor python api doc

* fix reviewed problem

* fix reviewed problem
2023-03-21 14:20:28 +08:00
guxukai
ab38c9110f [CVCUDA]add op Python API: Cast, HWC2CHW, Normalize, PadToSize, Resize, StridePad (#1589)
* add Cast, HWC2CHW, Normalize, PadToSize, StridePad

* add comments

* fix comments

* fix manager.cc
2023-03-14 19:16:07 +08:00
guxukai
f8d56a2424 [CVCUDA] wrap C processors in Python API (#1576)
* wrap C ops in Python API

* add comments

* change processor create style

* processors class inherit
2023-03-13 13:56:25 +08:00
guxukai
c6480de736 [CVCUDA] Vision Processor Python API and Tutorial (#1394)
* bind success

* bind success fix

* FDMat pybind, ResizeByShort pybind

* FDMat pybind, ResizeByShort pybind, remove initialized_

* override BindProcessorManager::Run in python is available

* PyProcessorManager done

* vision_pybind fix

* manager.py fix

* add tutorials

* remove Apply() bind

* remove Apply() bind and fix

* fix reviewed problem

* fix reviewed problem

* fix reviewed problem readme

* fix reviewed problem readme etc

* apply return outputs

* nits

* update readme

* fix FDMatbatch

* add op pybind: CenterCrop, Pad

* add op overload for pass FDMatBatch

---------

Co-authored-by: Wang Xinyu <shaywxy@gmail.com>
2023-03-10 14:42:32 +08:00
Jack Zhou
f7ef464412 [Other] Use symbolic link pointed to TensorRT library (#1461)
* Add force rpath

* update to dev-6

* remove force-rpath

* remove nvinfer so

* Add symbol link creation when import fastdeploy first

* Add dst

* update symbol link creation

* Add logging

* logging -> logger

* update tips

* Set logging level

* Add --force-rpath
2023-03-10 09:09:04 +08:00
Zheng-Bicheng
32f0d2e350 [Model] update PPDet pybind and docs (#1550)
update pybind and docs
2023-03-09 16:22:31 +08:00
Zheng-Bicheng
0687d3b0ad [Model] Add Solov2 For PaddleDetection (#1435)
* update solov2

* Repair note

* update solov2 postprocess

* update

* update solov2

* update solov2

* fixed bug

* fixed bug

* update solov2

* update solov2

* fix build android bug

* update docs

* update docs

* update docs

* update

* update

* update arch and docs

* update

* update

* update solov2 python

---------

Co-authored-by: DefTruth <31974251+DefTruth@users.noreply.github.com>
2023-03-08 10:01:32 +08:00
Zheng-Bicheng
1e56d5069c update 2023-03-07 23:02:43 +08:00
Zheng-Bicheng
7bed7a5053 update 2023-03-07 22:46:34 +08:00
yunyaoXYY
356787304c update fastdeploy-tools to 0.0.5 2023-03-02 06:15:59 +00:00
yunyaoXYY
4571e3c172 Merge branch 'develop' of https://github.com/PaddlePaddle/FastDeploy into new_dev 2023-03-02 06:11:37 +00:00
Wang Xinyu
044ab993d2 [CVCUDA] PP-OCR Cls & Rec preprocessor support CV-CUDA (#1470)
* ppocr cls preprocessor use manager

* hwc2chw cvcuda

* ppocr rec preproc use manager

* ocr rec preproc cvcuda

* fix rec preproc bug

* ppocr cls&rec preproc set normalize

* fix pybind

* address comment
2023-03-02 10:50:44 +08:00
yunyaoXYY
b27bb42665 update fastdeploy-toos to version of 0.0.4 2023-02-28 11:40:49 +00:00
Jack Zhou
0e67d95d57 [Other] Fix order of paddle and fastdeploy (#1451)
* Fix order of paddle and fastdeploy

* update comment
2023-02-28 09:58:19 +08:00
Zheng-Bicheng
8c3ccc2cc2 [Hackathon 182 Model] Update PPOCRV3 For RKNPU2 (#1403)
* update ppocrv3 for rknpu2

* add config

* add config

* detele unuseful

* update useful results

* Repair note

* Repair note

* fixed bugs

* update
2023-02-27 15:01:17 +08:00
Zheng-Bicheng
88c4f075e2 [Bug Fix] Fix the error when tinypose uses python under rknpu (#1437)
fixed bug
2023-02-27 09:41:13 +08:00
yunyaoXYY
df79c58814 [Doc] Improve PPOCR API docs. (#1428)
* Add Huawei Ascend NPU deploy through PaddleLite CANN

* Add NNAdapter interface for paddlelite

* Modify Huawei Ascend Cmake

* Update way for compiling Huawei Ascend NPU deployment

* remove UseLiteBackend in UseCANN

* Support compile python whlee

* Change names of nnadapter API

* Add nnadapter pybind and remove useless API

* Support Python deployment on Huawei Ascend NPU

* Fix links in readme

* Fix links in readme

* Update PPOCRv2/v3 examples

* Update auto compression configs

* Add neww quantization  support for paddleclas model

* Update quantized Yolov6s model download link

* Improve PPOCR comments

* Add models suppor for ascend

* Add PPOCR rec reszie for ascend

* fix conflict for ascend

* Rename CANN to Ascend

* Rename CANN to Ascend

* Improve ascend

* fix ascend bug

* improve ascend docs

* improve ascend docs

* improve ascend docs

* Add English doc for quantization

* Improve Ascend

* Improve Ascend

* Move ascend python demo

* Imporve ascend

* Fix PPOCR rec model bug

* Improve ascend

* Improve ascend

* Improve ascend

* Improve ascend

* Add  new paddleseg quantization support

* Add  new paddleseg quantization support

* Add  new paddleseg quantization support

* Add  new paddleseg quantization support

* Imporve ascend

* Imporve ascend

* Improve ascend

* acc eval script

* acc eval

* remove acc_eval from branch huawei

* Add detection and segmentation examples for Ascend deployment

* Add detection and segmentation examples for Ascend deployment

* Add Ascend model list

* Add ascend model list

* Add ascend model list

* Add ascend model list

* Add ascend model list

* Add ascend model list

* Add ascend model list

* Add PPOCR example for ascend deploy

* Imporve paddle lite compiliation

* Add FlyCV doc

* Add FlyCV doc

* Add FlyCV doc

* Imporve Ascend docs

* Imporve Ascend docs

* Improve PPOCR example

* Support Ascend deployment on X86 platform

* Improve Ascend docs

* Improve ascend

* Improve ascend

* Change Paddle Lite Ascend URL

* fix ascend docs

* fix ascend docs

* Fix Paddle Lite Ascend Lib

* Imporve compile of Ascend

* Imporve compile of Ascend

* fix paddle lite compile

* Remove useless opencv code for ocr

* Improve PPOCR API docs

* Improve PPOCR API docs

* Improve PPOCR API docs
2023-02-24 09:45:39 +08:00
Wang Xinyu
91a1c72f98 [CVCUDA] PP-OCR detector preprocessor integrate CV-CUDA (#1382)
* move manager initialized_ flag to ppcls

* update dbdetector preprocess api

* declare processor op

* ppocr detector preprocessor support cvcuda

* move cvcuda op to class member

* ppcls use manager register api

* refactor det preprocessor init api

* add set preprocessor api

* add create processor macro

* new processor call api

* ppcls preprocessor init resize on cpu

* ppocr detector preprocessor set normalize api

* revert ppcls pybind

* remove dbdetector set preprocessor

* refine dbdetector preprocessor includes

* remove mean std in py constructor

* add comments

* update comment

* Update __init__.py
2023-02-22 19:39:11 +08:00
Jason
dc5b4be7a9 [Other] Enable to hidden INFO/WARNING log informations (#1368)
* Enable to hidden INFO/WARNING log informations

* Fix build error

---------

Co-authored-by: root <root@bjyz-sys-gpu-kongming3.bjyz.baidu.com>
2023-02-20 17:24:12 +08:00
Zheng-Bicheng
2b7c23683a 按照要求更新 2023-02-16 10:38:10 +08:00
huangjianhui
9a74b44f8a Merge branch 'develop' into matting 2023-02-14 18:49:39 +08:00
CoolCola
a5d23c57d0 [Bug fix]add yolov7face landmarks (#1297)
* add yolov7face benchmark

* fix review problem

* fix review problems
2023-02-14 18:36:28 +08:00
WJJ1995
c25d1cc1bc [Backend]Fixed enable_paddle_to_trt() bug (#1320)
* add GPL lisence

* add GPL-3.0 lisence

* add GPL-3.0 lisence

* add GPL-3.0 lisence

* support yolov8

* add pybind for yolov8

* add yolov8 readme

* add cpp benchmark

* add cpu and gpu mem

* public part split

* add runtime mode

* fixed bugs

* add cpu_thread_nums

* deal with comments

* deal with comments

* deal with comments

* rm useless code

* add FASTDEPLOY_DECL

* add FASTDEPLOY_DECL

* fixed for windows

* mv rss to pss

* mv rss to pss

* Update utils.cc

* use thread to collect mem

* Add ResourceUsageMonitor

* rm useless code

* fixed bug

* fixed typo

* update ResourceUsageMonitor

* fixed bug

* fixed bug

* add note for ResourceUsageMonitor

* deal with comments

* add macros

* deal with comments

* deal with comments

* deal with comments

* re-lint

* rm pmap and use mem api

* rm pmap and use mem api

* add mem api

* Add PrintBenchmarkInfo func

* Add PrintBenchmarkInfo func

* Add PrintBenchmarkInfo func

* deal with comments

* fixed enable_paddle_to_trt

* add log for paddle_trt

---------

Co-authored-by: DefTruth <31974251+DefTruth@users.noreply.github.com>
2023-02-14 17:51:39 +08:00
huangjianhui
6d72073d09 Merge branch 'develop' into matting 2023-02-14 17:39:12 +08:00
Wang Bojun
a0fc0d5e49 Merge branch 'develop' into set_stream_infer-shareExData 2023-02-14 14:23:33 +08:00
wwbitejotunn
727fdc5863 reuse setStream c++ interface, add set_raw_stream python api 2023-02-14 06:22:47 +00:00
huangjianhui
f4371b3c6d Merge branch 'develop' into matting 2023-02-14 11:41:17 +08:00
felixhjh
619b561817 Update api && comments 2023-02-14 03:18:54 +00:00
felixhjh
031d02275b Merge branch 'encrypt_model' of https://github.com/felixhjh/FastDeploy into encrypt_model 2023-02-13 06:32:19 +00:00
felixhjh
45b070e495 Format code 2023-02-13 06:31:04 +00:00
wwbitejotunn
289d353d99 Merge branch 'develop' of https://github.com/paddlepaddle/fastdeploy into set_stream_infer-shareExData 2023-02-13 03:14:18 +00:00
wwbitejotunn
abfa9fd850 prebind output by shareExternalData 2023-02-13 03:11:31 +00:00
huangjianhui
a30213b504 Merge branch 'develop' into encrypt_model 2023-02-13 10:42:46 +08:00
Zheng-Bicheng
6a3ac91057 [Model] Update rkyolo pybind (#1294)
更新rkyolo pybind
2023-02-11 09:09:53 +08:00
felixhjh
942cee83d7 Add decrypt function to load encrypted model 2023-02-09 14:04:10 +00:00
Jason
b8afb0d040 [Other] Move comments for deprecated functions (#1275)
Move comments for deprecated functions
2023-02-09 10:04:18 +08:00
Jason
a4b0565b9a [Other] Optimize paddle backend (#1265)
* Optimize paddle backend

* optimize paddle backend

* add version support
2023-02-08 19:12:03 +08:00
guxukai
9cd00ad4c5 [Model] Refactoring code of YOLOv5Cls with new model type (#1237)
* Refactoring code of YOLOv5Cls with new model type

* fix reviewed problem

* Normalize&HWC2CHW -> NormalizeAndPermute

* remove cast()
2023-02-08 11:19:00 +08:00
Jason
713afe7f1c [Other] Deprecate some option api and parameters (#1243)
* Optimize Poros backend

* fix error

* Add more pybind

* fix conflicts

* add some deprecate notices

* [Other] Deprecate some apis in RuntimeOption (#1240)

* Deprecate more options

* modify serving

* Update option.h

* fix tensorrt error

* Update option_pybind.cc

* Update option_pybind.cc

* Fix error in serving

* fix word spell error
2023-02-07 17:57:46 +08:00
guxukai
1c115bb237 [Model] Add facedet model: CenterFace (#1131)
* cpp example run success

* add landmarks

* fix reviewed problem

* add pybind

* add readme in examples

* fix reviewed problem

* new file:   tests/models/test_centerface.py

* fix reviewed problem 230202
2023-02-07 14:05:08 +08:00
Wang Xinyu
d3d914856d [CVCUDA] Utilize CV-CUDA batch processing function (#1223)
* norm and permute batch processing

* move cache to mat, batch processors

* get batched tensor logic, resize on cpu logic

* fix cpu compile error

* remove vector mat api

* nits

* add comments

* nits

* fix batch size

* move initial resize on cpu option to use_cuda api

* fix pybind

* processor manager pybind

* rename mat and matbatch

* move initial resize on cpu to ppcls preprocessor

---------

Co-authored-by: Jason <jiangjiajun@baidu.com>
2023-02-07 13:44:30 +08:00
Jason
7c9bf11c44 [Other] Optimize Poros backend (#1232)
* Optimize Poros backend

* fix error

* Add more pybind

* fix conflicts

* add some deprecate notices
2023-02-07 10:18:03 +08:00
DefTruth
f73a538f61 [Backend] support bechmark mode for runtime and backend (#1201)
* [backend] support bechmark mode for runtime and backend

* [backend] support bechmark mode for runtime and backend

* [pybind11] add benchmark methods pybind

* [pybind11] add benchmark methods pybind

* [Other] Update build scripts

* [Other] Update cmake/summary.cmake

* [Other] update build scripts

* [Other] add ENABLE_BENCHMARK option -> setup.py

* optimize backend time recording

* optimize backend time recording

* optimize trt backend time record

* [backend] optimze backend_time recording for trt

* [benchmark] remove redundant logs

* fixed ov_backend confilct

* [benchmark] fixed paddle_backend conflicts

* [benchmark] fixed paddle_backend conflicts

* [benchmark] fixed paddle_backend conflicts

* [benchmark] remove use_gpu option from ort backend option

* [benchmark] update benchmark_ppdet.py

* [benchmark] update benchmark_ppcls.py

* fixed lite backend conflicts

* [Lite] fixed lite xpu

* add benchmark macro

* add RUNTIME_PROFILE_LOOP macros

* add comments for RUNTIME_PROFILE macros

* add comments for new apis

* add comments for new apis

* update benchmark_ppdet.py

* afixed bugs

* remove unused codes

* optimize RUNTIME_PROFILE_LOOP macros

* optimize RUNTIME_PROFILE_LOOP macros

* add comments for benchmark option and result

* add docs for benchmark namespace
2023-02-06 14:29:35 +08:00
CoolCola
42d14e7119 [Model] Support BlazeFace Model (#1172)
* fit yolov7face file path

* TODO:添加yolov7facePython接口Predict

* resolve yolov7face.py

* resolve yolov7face.py

* resolve yolov7face.py

* add yolov7face example readme file

* [Doc] fix yolov7face example readme file

* [Doc]fix yolov7face example readme file

* support BlazeFace

* add blazeface readme file

* fix review problem

* fix code style error

* fix review problem

* fix review problem

* fix head file problem

* fix review problem

* fix review problem

* fix readme file problem

* add English readme file

* fix English readme file
2023-02-06 14:24:12 +08:00
huangjianhui
76df90afc3 [Other] FastDeploy TensorRT && ONNX backend support to load model form memory (#1130)
* Update all backends load model from buffer

* Delete redundant code

* Format code style

* Format code style

* Delete redundant code

* Delete redundant code

* Add some FDASSERTs

* Update load model form memory when cloning engine

* Update clone engine code

* Update set_model_buffer api parameters with char pointer

* Release memory buffer variables after finish init backends

* Fix conflict

* Fix bug
2023-02-01 11:36:09 +08:00
Zilong Xing
a709fe4813 [SOPHGO] Add PaddleDetection YOLOv8 example (#1165)
sophon yolov8s example

Co-authored-by: Jason <jiangjiajun@baidu.com>
2023-01-30 11:47:07 +08:00