apps/FastDeploy
1
0
Fork 0
mirror of https://github.com/PaddlePaddle/FastDeploy.git synced 2025-10-06 00:57:33 +08:00
Code Issues Actions 2 Packages Projects Releases Wiki Activity
2,258 Commits 23 Branches 7 Tags
409c5dc05669b51a8fcc392cd161f24956761491
Commit Graph

474 Commits

Author SHA1 Message Date
Jason
db471c3466 [Other] Optimize poros backend (#1331) 
* Optimize poros backend

* Fix pybind error

---------

Co-authored-by: root <root@bjyz-sys-gpu-kongming3.bjyz.baidu.com>
 2023-02-17 14:32:35 +08:00
yunyaoXYY
c38b7d4377 [Backend] Support onnxruntime DirectML inference. (#1304) 
* Fix links in readme

* Fix links in readme

* Update PPOCRv2/v3 examples

* Update auto compression configs

* Add neww quantization  support for paddleclas model

* Update quantized Yolov6s model download link

* Improve PPOCR comments

* Add English doc for quantization

* Fix PPOCR rec model bug

* Add  new paddleseg quantization support

* Add  new paddleseg quantization support

* Add  new paddleseg quantization support

* Add  new paddleseg quantization support

* Add Ascend model list

* Add ascend model list

* Add ascend model list

* Add ascend model list

* Add ascend model list

* Add ascend model list

* Add ascend model list

* Support DirectML in onnxruntime

* Support onnxruntime DirectML

* Support onnxruntime DirectML

* Support onnxruntime DirectML

* Support OnnxRuntime DirectML

* Support OnnxRuntime DirectML

* Support OnnxRuntime DirectML

* Support OnnxRuntime DirectML

* Support OnnxRuntime DirectML

* Support OnnxRuntime DirectML

* Support OnnxRuntime DirectML

* Support OnnxRuntime DirectML

* Remove DirectML vision model example

* Imporve OnnxRuntime DirectML

* Imporve OnnxRuntime DirectML

* fix opencv cmake in Windows

* recheck codestyle
 2023-02-17 10:53:51 +08:00
Wang Xinyu
efa46563f3 [nvJPEG] Integrate nvJPEG decoder (#1288) 
* nvjpeg cmake

* add common decoder, nvjpeg decoder and add image name predict api

* ppclas support nvjpeg decoder

* remove useless comments

* image decoder support opencv

* nvjpeg decode fallback to opencv

* fdtensor add nbytes_allocated

* single image decode api

* fix bug

* add pybind

* ignore nvjpeg on jetson

* fix cmake in

* predict on fdmat

* remove image names predict api, add image decoder tutorial

* Update __init__.py

* fix pybind
 2023-02-17 10:27:05 +08:00
Zheng-Bicheng
b829a4e23c Merge branch 'develop' into tiny_pose 2023-02-16 17:35:02 +08:00
DefTruth
ee85a3cade [Benchmark] Add precision evaluation api from benchmark (#1310) 
* [Benchmark] Init benchmark precision api

* [Benchmark] Init benchmark precision api

* [Benchmark] Add benchmark precision api

* [Benchmark] Calculate the statis of diff

* [Benchmark] Calculate the statis of diff

* [Benchmark] Calculate the statis of diff

* [Benchmark] Calculate the statis of diff

* [Benchmark] Calculate the statis of diff

* [Benchmark] Add SplitDataLine utils

* [Benchmark] Add LexSortByXY func

* [Benchmark] Add LexSortByXY func

* [Benchmark] Add LexSortDetectionResultByXY func

* [Benchmark] Add LexSortDetectionResultByXY func

* [Benchmark] Add tensor diff presicion test

* [Benchmark] fixed conflicts

* [Benchmark] fixed calc tensor diff

* fixed build bugs

* fixed ci bugs when WITH_TESTING=ON
 2023-02-16 17:16:14 +08:00
Zheng-Bicheng
2b7c23683a 按照要求更新 2023-02-16 10:38:10 +08:00
Zheng-Bicheng
8faca05280 更新pybind 2023-02-15 21:03:15 +08:00
Zheng-Bicheng
8c42b708f6 删除无用代码，更新python脚本 2023-02-15 21:01:06 +08:00
Zheng-Bicheng
2b1631b563 更新pptinypose模型 2023-02-15 20:55:26 +08:00
Zheng-Bicheng
53333c5db6 更新example 和模型转换代码 2023-02-15 20:37:42 +08:00
Zheng-Bicheng
4ccfbead16 更新Preprocess代码 2023-02-15 19:25:44 +08:00
huangjianhui
328b306d27 Merge branch 'develop' into matting 2023-02-15 11:18:36 +08:00
felixhjh
5dfd590741 Merge branch 'matting' of https://github.com/felixhjh/FastDeploy into matting 2023-02-15 03:18:15 +00:00
felixhjh
5daedd21a3 Refactor by comments 2023-02-15 03:17:51 +00:00
Jason
7a4b2f3177 [Other] Optimize rknpu2 backend (#1318) 
* Optimize rknpu2 backend

* Fix error

* Fix comparision error
 2023-02-15 11:11:37 +08:00
huangjianhui
9a74b44f8a Merge branch 'develop' into matting 2023-02-14 18:49:39 +08:00
CoolCola
a5d23c57d0 [Bug fix]add yolov7face landmarks (#1297) 
* add yolov7face benchmark

* fix review problem

* fix review problems
 2023-02-14 18:36:28 +08:00
WJJ1995
c25d1cc1bc [Backend]Fixed enable_paddle_to_trt() bug (#1320) 
* add GPL lisence

* add GPL-3.0 lisence

* add GPL-3.0 lisence

* add GPL-3.0 lisence

* support yolov8

* add pybind for yolov8

* add yolov8 readme

* add cpp benchmark

* add cpu and gpu mem

* public part split

* add runtime mode

* fixed bugs

* add cpu_thread_nums

* deal with comments

* deal with comments

* deal with comments

* rm useless code

* add FASTDEPLOY_DECL

* add FASTDEPLOY_DECL

* fixed for windows

* mv rss to pss

* mv rss to pss

* Update utils.cc

* use thread to collect mem

* Add ResourceUsageMonitor

* rm useless code

* fixed bug

* fixed typo

* update ResourceUsageMonitor

* fixed bug

* fixed bug

* add note for ResourceUsageMonitor

* deal with comments

* add macros

* deal with comments

* deal with comments

* deal with comments

* re-lint

* rm pmap and use mem api

* rm pmap and use mem api

* add mem api

* Add PrintBenchmarkInfo func

* Add PrintBenchmarkInfo func

* Add PrintBenchmarkInfo func

* deal with comments

* fixed enable_paddle_to_trt

* add log for paddle_trt

---------

Co-authored-by: DefTruth <31974251+DefTruth@users.noreply.github.com>
 2023-02-14 17:51:39 +08:00
huangjianhui
6d72073d09 Merge branch 'develop' into matting 2023-02-14 17:39:12 +08:00
felixhjh
39639009d1 Refactor code 2023-02-14 09:34:06 +00:00
Jack Zhou
41c5f2de5a Merge pull request #1305 from wwbitejotunn/set_stream_infer-shareExData 
[Backend] Set inference with extra stream and prebind output tensor with share ex data
 2023-02-14 17:08:56 +08:00
Zheng-Bicheng
cd5a54cd75 [Bug Fix] Fix the bug reported by RK3568 Runtime under the latest driver (#1311) 
* 更新rkyolo runtime 在rk3568最新驱动下报错的问题

* 删除debug代码
 2023-02-14 15:40:15 +08:00
WJJ1995
2dfda1db85 [Benchmark] Remove pmap and use mem api (#1309) 
* add GPL lisence

* add GPL-3.0 lisence

* add GPL-3.0 lisence

* add GPL-3.0 lisence

* support yolov8

* add pybind for yolov8

* add yolov8 readme

* add cpp benchmark

* add cpu and gpu mem

* public part split

* add runtime mode

* fixed bugs

* add cpu_thread_nums

* deal with comments

* deal with comments

* deal with comments

* rm useless code

* add FASTDEPLOY_DECL

* add FASTDEPLOY_DECL

* fixed for windows

* mv rss to pss

* mv rss to pss

* Update utils.cc

* use thread to collect mem

* Add ResourceUsageMonitor

* rm useless code

* fixed bug

* fixed typo

* update ResourceUsageMonitor

* fixed bug

* fixed bug

* add note for ResourceUsageMonitor

* deal with comments

* add macros

* deal with comments

* deal with comments

* deal with comments

* re-lint

* rm pmap and use mem api

* rm pmap and use mem api

* add mem api

* Add PrintBenchmarkInfo func

* Add PrintBenchmarkInfo func

* Add PrintBenchmarkInfo func

* deal with comments

---------

Co-authored-by: DefTruth <31974251+DefTruth@users.noreply.github.com>
 2023-02-14 15:00:05 +08:00
Wang Bojun
a0fc0d5e49 Merge branch 'develop' into set_stream_infer-shareExData 2023-02-14 14:23:33 +08:00
wwbitejotunn
727fdc5863 reuse setStream c++ interface, add set_raw_stream python api 2023-02-14 06:22:47 +00:00
huangjianhui
f4371b3c6d Merge branch 'develop' into matting 2023-02-14 11:41:17 +08:00
huangjianhui
0a6869b650 Update visualize.h 2023-02-14 11:32:33 +08:00
huangjianhui
c62dbb7367 Update visualize.h 2023-02-14 11:24:08 +08:00
huangjianhui
7bd8bbfb84 Update visualize_pybind.cc 2023-02-14 11:21:44 +08:00
felixhjh
619b561817 Update api && comments 2023-02-14 03:18:54 +00:00
wwbitejotunn
f1ab47a4ef code revine 2023-02-13 18:16:45 +00:00
felixhjh
815c42c73d Update VisMatting function supports matting with transparent background 2023-02-13 15:28:02 +00:00
felixhjh
031d02275b Merge branch 'encrypt_model' of https://github.com/felixhjh/FastDeploy into encrypt_model 2023-02-13 06:32:19 +00:00
felixhjh
45b070e495 Format code 2023-02-13 06:31:04 +00:00
wwbitejotunn
289d353d99 Merge branch 'develop' of https://github.com/paddlepaddle/fastdeploy into set_stream_infer-shareExData 2023-02-13 03:14:18 +00:00
wwbitejotunn
abfa9fd850 prebind output by shareExternalData 2023-02-13 03:11:31 +00:00
huangjianhui
a30213b504 Merge branch 'develop' into encrypt_model 2023-02-13 10:42:46 +08:00
Zheng-Bicheng
6a3ac91057 [Model] Update rkyolo pybind (#1294) 
更新rkyolo pybind
 2023-02-11 09:09:53 +08:00
WJJ1995
59a4ab343f [Benchmark]Add ResourceUsageMonitor to collect memory info (#1269) 
* add GPL lisence

* add GPL-3.0 lisence

* add GPL-3.0 lisence

* add GPL-3.0 lisence

* support yolov8

* add pybind for yolov8

* add yolov8 readme

* add cpp benchmark

* add cpu and gpu mem

* public part split

* add runtime mode

* fixed bugs

* add cpu_thread_nums

* deal with comments

* deal with comments

* deal with comments

* rm useless code

* add FASTDEPLOY_DECL

* add FASTDEPLOY_DECL

* fixed for windows

* mv rss to pss

* mv rss to pss

* Update utils.cc

* use thread to collect mem

* Add ResourceUsageMonitor

* rm useless code

* fixed bug

* fixed typo

* update ResourceUsageMonitor

* fixed bug

* fixed bug

* add note for ResourceUsageMonitor

* deal with comments

---------

Co-authored-by: DefTruth <31974251+DefTruth@users.noreply.github.com>
 2023-02-10 17:13:22 +08:00
huangjianhui
e8b55ab3c6 Merge branch 'develop' into encrypt_model 2023-02-10 13:03:40 +08:00
felixhjh
5160771a1c Update runtime_option.h 2023-02-10 03:24:45 +00:00
felixhjh
942cee83d7 Add decrypt function to load encrypted model 2023-02-09 14:04:10 +00:00
wwbitejotunn
898b063216 get cache dir 2023-02-09 20:56:55 +08:00
wwbitejotunn
c2e5f6317e fix paddle backend 2023-02-09 20:56:55 +08:00
wwbitejotunn
59c5fedc36 set stream by raw size_t 2023-02-09 12:53:08 +00:00
yeliang2258
4742f97819 [Bug Fix] Fix KunlunXin valid_places (#1285) 
fix KunlunXin valid_places
 2023-02-09 20:39:44 +08:00
wwbitejotunn
4b293a89de fix paddle backend 2023-02-09 05:51:30 +00:00
DefTruth
ab5377b5fa [Benchmark] Add PaddleYOLOv8 cpp benchmark example & lite flags option (#1270) 
* [Android] Add PaddleYOLOv8 cpp benchmark example & lite flags option

* [Benchmark] add linux x86_64 gpu benchmark build script
 2023-02-09 11:58:07 +08:00
Jason
b8afb0d040 [Other] Move comments for deprecated functions (#1275) 
Move comments for deprecated functions
 2023-02-09 10:04:18 +08:00
Jason
0fb2f26352 [Other] Optimize sophgo backend (#1273) 
optimize sophgo backend
 2023-02-08 19:50:37 +08:00