apps/FastDeploy
1
0
Fork 0
mirror of https://github.com/PaddlePaddle/FastDeploy.git synced 2025-10-08 18:11:00 +08:00
Code Issues Actions 2 Packages Projects Releases Wiki Activity
2,258 Commits 23 Branches 7 Tags
409c5dc05669b51a8fcc392cd161f24956761491
Commit Graph

122 Commits

Author SHA1 Message Date
DefTruth
2ff7b10adc [cmake] switch paddle 2.4-dev7 -> 2.4-dev6 for windows (#1660) 
* [cmake] switch paddle 2.4-dev7 -> 2.4-dev6 for windows

* [cmake] remove examples from install policy

* Update CMakeLists.txt
 2023-03-21 10:41:34 +08:00
Jason
6343b0db47 [Build] Support build with source code of Paddle2ONNX (#1559) 
* Add notes for tensors

* Optimize some apis

* move some warnings

* Support build with Paddle2ONNX

* Add protobuf support

* Fix compile on mac

* add clearn package script

* Add paddle2onnx code

* remove submodule

* Add onnx ocde

* remove softlink

* add onnx code

* fix error

* Add cmake file

* fix patchelf

* update paddle2onnx

* Delete .gitmodules

---------

Co-authored-by: PaddleCI <paddle_ci@example.com>
Co-authored-by: pangyoki <pangyoki@126.com>
Co-authored-by: jiangjiajun <jiangjiajun@baidu.lcom>
 2023-03-17 10:03:22 +08:00
DefTruth
f568c59698 [cmake] update examples install policy on windows (#1638) 
Co-authored-by: Jason <jiangjiajun@baidu.com>
 2023-03-17 10:00:40 +08:00
Jack Zhou
f7ef464412 [Other] Use symbolic link pointed to TensorRT library (#1461) 
* Add force rpath

* update to dev-6

* remove force-rpath

* remove nvinfer so

* Add symbol link creation when import fastdeploy first

* Add dst

* update symbol link creation

* Add logging

* logging -> logger

* update tips

* Set logging level

* Add --force-rpath
 2023-03-10 09:09:04 +08:00
Jason
bf2ba72f1b [Compile] Support build FastDeploy with GLIBCXX_ABI=0 (#1528) 
* Support abi=0 build

* trigger ci

* fix cmake
 2023-03-07 09:45:30 +08:00
DefTruth
767647d88e [Android] Add WITH_TENSOR_FUNCS option -> Android (#1512) 
* [Android] Add WITH_TENSOR_FUNCS option -> Android

* [Android] move android cmake codes -> android.cmake

* [Android] move android cmake codes -> android.cmake
 2023-03-06 13:33:43 +08:00
DefTruth
95f809c1ff [Bug Fix] fix build error while enable flycv on linux x64 (#1365) 
* [Bug Fix] fix build error while enable flycv on linux x64

* [Bug Fix] fix build error while enable flycv on linux x64

* move WITH_FLYCV_STATIC option -> flycv.cmake
 2023-02-20 13:52:31 +08:00
yunyaoXYY
c38b7d4377 [Backend] Support onnxruntime DirectML inference. (#1304) 
* Fix links in readme

* Fix links in readme

* Update PPOCRv2/v3 examples

* Update auto compression configs

* Add neww quantization  support for paddleclas model

* Update quantized Yolov6s model download link

* Improve PPOCR comments

* Add English doc for quantization

* Fix PPOCR rec model bug

* Add  new paddleseg quantization support

* Add  new paddleseg quantization support

* Add  new paddleseg quantization support

* Add  new paddleseg quantization support

* Add Ascend model list

* Add ascend model list

* Add ascend model list

* Add ascend model list

* Add ascend model list

* Add ascend model list

* Add ascend model list

* Support DirectML in onnxruntime

* Support onnxruntime DirectML

* Support onnxruntime DirectML

* Support onnxruntime DirectML

* Support OnnxRuntime DirectML

* Support OnnxRuntime DirectML

* Support OnnxRuntime DirectML

* Support OnnxRuntime DirectML

* Support OnnxRuntime DirectML

* Support OnnxRuntime DirectML

* Support OnnxRuntime DirectML

* Support OnnxRuntime DirectML

* Remove DirectML vision model example

* Imporve OnnxRuntime DirectML

* Imporve OnnxRuntime DirectML

* fix opencv cmake in Windows

* recheck codestyle
 2023-02-17 10:53:51 +08:00
Wang Xinyu
efa46563f3 [nvJPEG] Integrate nvJPEG decoder (#1288) 
* nvjpeg cmake

* add common decoder, nvjpeg decoder and add image name predict api

* ppclas support nvjpeg decoder

* remove useless comments

* image decoder support opencv

* nvjpeg decode fallback to opencv

* fdtensor add nbytes_allocated

* single image decode api

* fix bug

* add pybind

* ignore nvjpeg on jetson

* fix cmake in

* predict on fdmat

* remove image names predict api, add image decoder tutorial

* Update __init__.py

* fix pybind
 2023-02-17 10:27:05 +08:00
chenjian
f43ff32752 [C# api] add c sharp api for fastdeploy (#1246) 
* add c sharp api for fastdeploy

* update accroding to c apis

* add cmakelist for c sharp api

* add cmakelists for c sharp

* fix cmakelists

* fix cmakelists

* add c sharp api for fastdeploy

* add ppyoloe demo

* add ppyoloe demo

* modify demo namespace code

* add readme

* fix format

* format code

* fix doc

---------

Co-authored-by: heliqi <1101791222@qq.com>
 2023-02-15 14:27:31 +08:00
chenjian
abae858f09 [C api] Add install command for c api and a demo in paddledection (#1289) 
* add c api demo and fix  bugs

* fix doc

* add config.h.in

* add config.h.in

* add config.h.in
 2023-02-14 14:28:23 +08:00
chenjian
3eb571a047 [C API] Add c api to fastdeploy (#1217) 
* add c api to test ppclas model

* fix

* add ppdet

* refactor c api code

* remove local test make

* fix a bug

* fix according to review

* format file

* format file

* format file

* add types_internal.cc

---------

Co-authored-by: heliqi <1101791222@qq.com>
 2023-02-09 10:19:40 +08:00
DefTruth
e90e1ff435 [Android] fix flycv android cmake bug (#1248) 2023-02-07 21:20:19 +08:00
DefTruth
f73a538f61 [Backend] support bechmark mode for runtime and backend (#1201) 
* [backend] support bechmark mode for runtime and backend

* [backend] support bechmark mode for runtime and backend

* [pybind11] add benchmark methods pybind

* [pybind11] add benchmark methods pybind

* [Other] Update build scripts

* [Other] Update cmake/summary.cmake

* [Other] update build scripts

* [Other] add ENABLE_BENCHMARK option -> setup.py

* optimize backend time recording

* optimize backend time recording

* optimize trt backend time record

* [backend] optimze backend_time recording for trt

* [benchmark] remove redundant logs

* fixed ov_backend confilct

* [benchmark] fixed paddle_backend conflicts

* [benchmark] fixed paddle_backend conflicts

* [benchmark] fixed paddle_backend conflicts

* [benchmark] remove use_gpu option from ort backend option

* [benchmark] update benchmark_ppdet.py

* [benchmark] update benchmark_ppcls.py

* fixed lite backend conflicts

* [Lite] fixed lite xpu

* add benchmark macro

* add RUNTIME_PROFILE_LOOP macros

* add comments for RUNTIME_PROFILE macros

* add comments for new apis

* add comments for new apis

* update benchmark_ppdet.py

* afixed bugs

* remove unused codes

* optimize RUNTIME_PROFILE_LOOP macros

* optimize RUNTIME_PROFILE_LOOP macros

* add comments for benchmark option and result

* add docs for benchmark namespace
 2023-02-06 14:29:35 +08:00
WJJ1995
cfc7af2d45 [Benchmark] avoid Result mem copy for cpp benchmark (#1203) 
* avoid mem copy for cpp benchmark

* set CMAKE_BUILD_TYPE to Release
 2023-02-06 10:19:44 +08:00
heliqi
1427d5d29a [Bug] Vision and text compile source file add .cu file on CMakeLists.txt (#1188) 
* vision and text CMake add .cu file

* recover .cu file

* recover .cu file

* vision and text CMake add .cu file

* vision and text CMake add .cu file

* vision and text CMake add .cu file

* Update yolo_preprocess.cu
 2023-01-31 11:39:12 +08:00
DefTruth
2613e9c5d0 [Android] support fastdeploy build with static deps(60Mb->29~31Mb) (#1176) 
* [Android] support fastdeploy build with static deps(70Mb->17~19Mb)

* [Android] support fastdeploy build with static deps(60Mb->29~30Mb)

* fixed ci

* fixed ci

* [staticlib] support fd android static lib

* [static] optimize bundle_static_library func

* [staticlib] add api_helpers.h -> staticlib headers

* [staticlib] add api_helpers.h -> staticlib headers

* [staticlib] add api_helpers.h -> staticlib headers

* [staticlib] Fixed Paddle Lite paddle_use_kernels.h to support fd armv7 static lib

* [staticlib] Add strip -> fd static lib target

* [staticlib] optimize bundle_static_library func

* [staticlib] add strip for fd static lib on  mac osx

* [staticlib] move api_helpers -> lite/option

* [staticlib] optimize bundle_static_library

* [staticlib] add Android limit
 2023-01-30 19:39:56 +08:00
Wang Xinyu
62e051e21d [CVCUDA] CMake integration, vison processor CV-CUDA integration, PaddleClas support CV-CUDA (#1074) 
* cvcuda resize

* cvcuda center crop

* cvcuda resize

* add a fdtensor in fdmat

* get cv mat and get tensor support gpu

* paddleclas cvcuda preprocessor

* fix compile err

* fix windows compile error

* rename reused to cached

* address comment

* remove debug code

* add comment

* add manager run

* use cuda and cuda used

* use cv cuda doc

* address comment

---------

Co-authored-by: Jason <jiangjiajun@baidu.com>
 2023-01-30 09:33:49 +08:00
Wang Xinyu
3e5c219ab3 [Other] Generate Debian package and RPM package (#1043) 
* cpack deb

* cpack prerm script

* optim postinst script

* generate rpm package

* add build fd package doc

* update build fd package doc
 2023-01-10 10:26:58 +08:00
Jason
df20b2a02b [Other] Remove useless macros (#1095) 
* Remove useless macros

* triger ci

* fix check error

* rename INTEGRATE_PADDLE2ONNX to ENABLE_PADDLE2ONNX
 2023-01-09 21:35:23 +08:00
Jason
054dfec43a [Other] Remove some build options (#1090) 
* remove some flags

* add gpu check in cmake
 2023-01-09 17:36:07 +08:00
Jason
4aa4ebd7c3 [Other] [Part2] Upgrade runtime module (#1080) 
[Other] Upgrade runtime module
 2023-01-09 13:22:51 +08:00
Jason
d7a65e5c70 [Other] Upgrade runtime module (#1068) 
* Upgrade runtime module

* Update option.h

* Fix build error

* Move enumerates

* little modification

* little modification

* little modification:

* Remove some useless flags
 2023-01-06 13:44:05 +08:00
Dantès
34bea7649d [Backend] add sophgo backend (#1015) 
* Add Sophgo Device

add sophgo backend in fastdeploy

add resnet50, yolov5s, liteseg examples.

* replace sophgo lib with download links; fix model.cc bug

* modify CodeStyle

* remove unuseful files;change the names of sophgo device and sophgo
backend

* sophgo support python and add python examples

* remove unuseful rows in cmake according pr

Co-authored-by: Zilong Xing <zilong.xing@sophgo.com>
 2023-01-04 15:49:17 +08:00
Thomas Young
ab49b41080 add encryption (#1002) 
* add encryption

* add doc

* add doc

* fix bug
 2023-01-03 15:57:03 +08:00
Jason
f038268c79 [Bug Fix] Fix build with Paddle Inference on Jetson (#1019) 
Fix build with Paddle Inference on Jetson
 2022-12-30 15:06:13 +08:00
Wang Xinyu
f23c6c03af [Other] Remove TRT static libs in package (#1011) 
* remove duplicated and useless libs

* use os system to run ldd

* remove filter libs by ldd
 2022-12-30 11:58:56 +08:00
yeliang2258
45865c8724 [Other] Change all XPU to KunlunXin (#973) 
* [FlyCV] Bump up FlyCV -> official release 1.0.0

* XPU to KunlunXin

* update

* update model link

* update doc

* update device

* update code

* useless code

Co-authored-by: DefTruth <qiustudent_r@163.com>
Co-authored-by: DefTruth <31974251+DefTruth@users.noreply.github.com>
 2022-12-27 10:02:02 +08:00
yunyaoXYY
d45382e3cc [Backend] Add Huawei Ascend NPU deploy using PaddleLite CANN. (#757) 
* Add Huawei Ascend NPU deploy through PaddleLite CANN

* Add NNAdapter interface for paddlelite

* Modify Huawei Ascend Cmake

* Update way for compiling Huawei Ascend NPU deployment

* remove UseLiteBackend in UseCANN

* Support compile python whlee

* Change names of nnadapter API

* Add nnadapter pybind and remove useless API

* Support Python deployment on Huawei Ascend NPU

* Add models suppor for ascend

* Add PPOCR rec reszie for ascend

* fix conflict for ascend

* Rename CANN to Ascend

* Rename CANN to Ascend

* Improve ascend

* fix ascend bug

* improve ascend docs

* improve ascend docs

* improve ascend docs

* Improve Ascend

* Improve Ascend

* Move ascend python demo

* Imporve ascend

* Improve ascend

* Improve ascend

* Improve ascend

* Improve ascend

* Imporve ascend

* Imporve ascend

* Improve ascend
 2022-12-26 10:18:34 +08:00
WJJ1995
c8db4b442a [Runtime] Add Poros Backend Runtime demo for c++/python (#915) 
* add onnx_ort_runtime demo

* rm in requirements

* support batch eval

* fixed MattingResults bug

* move assignment for DetectionResult

* integrated x2paddle

* add model convert readme

* update readme

* re-lint

* add processor api

* Add MattingResult Free

* change valid_cpu_backends order

* add ppocr benchmark

* mv bs from 64 to 32

* fixed quantize.md

* fixed quantize bugs

* Add Monitor for benchmark

* update mem monitor

* Set trt_max_batch_size default 1

* fixed ocr benchmark bug

* support yolov5 in serving

* Fixed yolov5 serving

* Fixed postprocess

* update yolov5 to 7.0

* add poros runtime demos

* update readme

* Support poros abi=1

* rm useless note

* deal with comments

Co-authored-by: Jason <jiangjiajun@baidu.com>
 2022-12-20 19:03:14 +08:00
Wang Xinyu
81eaeddbd0 [Streamer] Basic framework, YAML parser, ppyoloe demo and video decoder demo (#863) 
* support trt installed in sys dir

* streamer init

* link elements and run

* create source bin

* add config

* restruct dirs

* set property

* link elements

* integrate perf

* add bbox parser

* parse yaml to string, video decoder

* use try pull for decoder and nits

* streamer ppyoloe cpp

* update readme

* video decoder cpp dir

* add cn readme

* update readme

* cmake nits

* refactor perf measurement
 2022-12-19 10:14:17 +08:00
Jason
2d998223ac [Backend] Add KunlunXin XPU deploy support (#894) 
Revert "Revert "[Backend] Add KunlunXin XPU deploy support" (#893)"

This reverts commit 0990ab9b50.
 2022-12-16 11:22:30 +08:00
Jason
0990ab9b50 Revert "[Backend] Add KunlunXin XPU deploy support" (#893) 
Revert "[Backend] Add KunlunXin XPU deploy support (#747)"

This reverts commit 5be839b322.
 2022-12-15 21:17:59 +08:00
yeliang2258
5be839b322 [Backend] Add KunlunXin XPU deploy support (#747) 
* add xpu support

* fix docs

* update code

* update doc

* update code

* update yolov5

* update cmake

* add int64_t data support

* fix

* update download links

* add en doc

* update code

* update xpu options

* update doc

* update doc

* update doc

* update lib links

* update doc

* update code

* update lite xpu link

* update xpu lib

* update doc

* update en doc
 2022-12-15 21:17:14 +08:00
DefTruth
2e342a35ba [Bug Fix] Fix gflags download timeout (#878) 
* [Doc] Add docs_i18n

* [cmake] fix gflags timeout

* Delete README_Ру́сский_язы́к.md

* Delete README_한국어.md

* Create README_Ру́сский_язы́к.md

* Delete README_Ру́сский_язы́к.md

* Update CMakeLists.txt

Co-authored-by: Jason <928090362@qq.com>
 2022-12-14 16:43:02 +08:00
Jason
8b6bb1723e [Compile] Force GLIBCXX_USE_CXX11_ABI=1 (#799) 
* Force =1

* Update CMakeLists.txt

* Update FastDeploy.cmake.in
 2022-12-05 19:44:04 +08:00
DefTruth
65f270df29 [FastTokenizer] Support FastTokenizer on Android (#783) 
* [FastTokenizer] Support FastTokenizer on Android

* [OMP] Add OMP bind_proc(close) policy

* [Android] Add Lite support for UIE

* [Android] Add VIS_SEG_OMP_NUM_THREADS
 2022-12-05 14:12:54 +08:00
Jason
5a0eaa1980 [Compile] Fix compile on windows (#765) 
Fix compile on windows
 2022-12-01 11:23:15 +08:00
Jason
49061bfb1c [Compile] Fix compile with ninja (#761) 
Fix compile with ninja

Co-authored-by: PaddleCI <paddle_ci@example.com>
 2022-11-30 21:08:27 +08:00
DefTruth
2a7705d7e8 [Bug Fix] fix libomp.so not found error (#715) 
* [Android] Add VisSegmentation NEON support

* [ARM] change vqaddq_u8 -> vaddq_u8

* [ARM] change vqaddq_u8 -> vaddq_u8

* [Bug Fix] add FDASSERT

* update assert info

* add QuantizeBlendingWeight8

* Update QuantizeBlendingWeight8

* Update VisSegmentation

* [Visualize] add DefaultVisualizeType and EnableFastVisuzlie

* fix typos

* fix typo

* Update VisSegmentation

* [Android] Add omp parallel support for Android

* Add omp schedule(static)

* [Bug Fix] fix libomp.so not found error
 2022-11-28 13:32:28 +08:00
Hao Guan
d8d030b02f [osx] detect cross compiling architecture (#712) 2022-11-28 11:26:19 +08:00
DefTruth
60b430f7be [ARM] Add VisSegmentation NEON + OMP support (#710) 
* [Android] Add VisSegmentation NEON support

* [ARM] change vqaddq_u8 -> vaddq_u8

* [ARM] change vqaddq_u8 -> vaddq_u8

* [Bug Fix] add FDASSERT

* update assert info

* add QuantizeBlendingWeight8

* Update QuantizeBlendingWeight8

* Update VisSegmentation

* [Visualize] add DefaultVisualizeType and EnableFastVisuzlie

* fix typos

* fix typo

* Update VisSegmentation

* [Android] Add omp parallel support for Android

* Add omp schedule(static)
 2022-11-28 10:10:38 +08:00
yeliang2258
d14828cb18 [Backend] Add AdaptivePool2d for TensorRT plugin (#668) 
* add adaptivepool2d for tensorrt plugin

* update code

* update code

* update code to fix bug
 2022-11-25 17:36:59 +08:00
DefTruth
256f7c2269 [Bug Fix] fixed ppdet postprocess empty result error (#691) 
* [Android] Add CxxBuffer to native PaddleSegModel

* [Android] Add PaddleSeg android app example

* [Android] Add SCRFD android app example

* [Doc] fix typos

* [Android] revert camera setting changes

* [Bug Fix] fixed ppdet postprocess empty result error
 2022-11-24 18:56:38 +08:00
yeliang2258
7206094ddd [Backend] Add ORT CPU and CUDA kernel for adaptive_pool OP (#609) 
* add ORT CPU and CUDA kernel for adaptive_pool

* update code

* update paddle2onnx version
 2022-11-24 10:39:29 +08:00
DefTruth
c4d43bdd9b [cmake] change -Os flag -> Ofast to boost performance on Android (#652) 
- change -Os flag -> Ofast to boost performance on Android
 2022-11-22 15:31:30 +08:00
Jason
2c90610020 Fix build error on Windows (#653) 2022-11-22 14:55:36 +08:00
jiangjiajun
46506761d5 Remove static libraries while building 2022-11-21 06:58:54 +00:00
Jack Zhou
eeae48deff [Other] faster_tokenizer->fast_tokenizer (#636) 
* faster_tokenizer->fast_tokenizer

* ErnieFasterTokenizer->ErnieFastTokenizer

* update the fastdeploy_init

Co-authored-by: Jason <jiangjiajun@baidu.com>
 2022-11-21 13:45:00 +08:00
DefTruth
6a368f3448 [Android] Support segmentation and facedet in Android (#567) 
* [FlyCV] Add global SetProcLibCpuNumThreads method

* [Android] Support segmentation and facedet in Android

* [Android] add JNI instance check to j_runtime_option_obj

* [Model] fixed ppseg flycv resize error

* [FlyCV] fix FlyCV resize flags

* [cmake] remove un-need lite compile option

* [Android] add PaddleSegModel JNI and fix some bugs

* [Android] bind PaddleSegModel via JNI

* [Android] bind VisSegmentation via JNI

* [Android] bind YOLOv5Face and SCRFD via JNI

* [Android] fix NewJavaFaceDetectionResultFromCxx error
 2022-11-13 17:47:50 +08:00