Zheng-Bicheng
b30f62af36
[Backend] Refactoring RKNPU2 Backend code ( #1772 )
...
* update rknpu2 runtime
* update rknpu2 runtime
* update rknpu2 runtime
* update for rknpu2 backend
* update for rknpu2 backend
---------
Co-authored-by: DefTruth <31974251+DefTruth@users.noreply.github.com >
2023-04-13 16:37:36 +08:00
yeliang2258
e2f5a9ce66
[Model] Add picodet for RV1126 and A311D ( #1549 )
...
* add infer for picodet
* update code
* update lite lib
---------
Co-authored-by: DefTruth <31974251+DefTruth@users.noreply.github.com >
2023-04-10 22:04:45 +08:00
guxukai
ed19c759df
[CVCUDA] Add CV-CUDA support in PaddleSeg ( #1761 )
...
* add cvcuda support in ppseg
* python and pybind
* add resize op, remove concat,std::move
* define resize op
2023-04-09 10:38:18 +08:00
Zheng-Bicheng
109d1046ae
[Model] add function for setting anchor rknpu2 ( #1728 )
...
* add function for setting anchor rknpu2
add more demo for rknpu2
fixed md error
* Update config.h
---------
Co-authored-by: DefTruth <31974251+DefTruth@users.noreply.github.com >
2023-04-04 20:33:06 +08:00
ChaoII
a2141d0d2c
[Doc] fix dead links ( #1732 )
...
* [Bug Fix]fix tracking 'LetterBoxResize'
* [Docs]Fix dead links
---------
Co-authored-by: DefTruth <31974251+DefTruth@users.noreply.github.com >
2023-04-03 13:09:57 +08:00
Yi-sir
9e20dab0d6
[Example] Merge Download Paddle Model, Paddle->ONNX->MLIR->BModel ( #1643 )
...
* fix infer.py and README
* [Example] Merge Download Paddle Model, Paddle->Onnx->Mlir->Bmodel and
inference into infer.py. Modify README.md
* modify pp_liteseg sophgo infer.py and README.md
* fix PPOCR,PPYOLOE,PICODET,LITESEG sophgo infer.py and README.md
* fix memory overflow problem while inferring with sophgo backend
* fix memory overflow problem while inferring with sophgo backend
---------
Co-authored-by: DefTruth <31974251+DefTruth@users.noreply.github.com >
Co-authored-by: xuyizhou <yizhou.xu@sophgo.com >
2023-03-31 15:08:01 +08:00
DefTruth
7d1b706caf
[Benchmark] Add pure runtime benchmark bin ( #1731 )
...
* [Benchmark] Add pure runtime benchmark bin
* [Benchmark] add cpu/gpu memory collect -> benchmark bin
* [Backend] update trt max_batch_size policy
* [backend] Update trt backend max_batch_size policy
* [Benchmark] Add more model format support -> benchmark bin
2023-03-30 19:03:30 +08:00
Zheng-Bicheng
644a085ca2
[Bug Fix] fix yolox's bug ( #1736 )
...
fix yolox's bug
Co-authored-by: DefTruth <31974251+DefTruth@users.noreply.github.com >
2023-03-29 21:03:37 +08:00
WJJ1995
409c5dc056
[Backend]Add default value for TRT SetShape() ( #1712 )
...
* add GPL lisence
* add GPL-3.0 lisence
* add GPL-3.0 lisence
* add GPL-3.0 lisence
* support yolov8
* add pybind for yolov8
* add yolov8 readme
* add cpp benchmark
* add cpu and gpu mem
* public part split
* add runtime mode
* fixed bugs
* add cpu_thread_nums
* deal with comments
* deal with comments
* deal with comments
* rm useless code
* add FASTDEPLOY_DECL
* add FASTDEPLOY_DECL
* fixed for windows
* mv rss to pss
* mv rss to pss
* Update utils.cc
* use thread to collect mem
* Add ResourceUsageMonitor
* rm useless code
* fixed bug
* fixed typo
* update ResourceUsageMonitor
* fixed bug
* fixed bug
* add note for ResourceUsageMonitor
* deal with comments
* add macros
* deal with comments
* deal with comments
* deal with comments
* re-lint
* rm pmap and use mem api
* rm pmap and use mem api
* add mem api
* Add PrintBenchmarkInfo func
* Add PrintBenchmarkInfo func
* Add PrintBenchmarkInfo func
* deal with comments
* fixed enable_paddle_to_trt
* add log for paddle_trt
* support ppcls benchmark
* use new trt option api
* update benchmark info
* simplify benchmark.cc
* simplify benchmark.cc
* deal with comments
* Add ppseg && ppocr benchmark
* add OCR rec img
* add ocr benchmark
* fixed trt shape
* add trt shape
* resolve conflict
* add ENABLE_BENCHMARK define
* Add ClassifyDiff
* Add Resize for ClassifyResult
* deal with comments
* add convert info script
* resolve conflict
* Add SaveBenchmarkResult func
* fixed bug
* fixed bug
* fixed bug
* add config.txt for option
* fixed bug
* fixed bug
* fixed bug
* add benchmark.sh
* mv thread_nums from 8 to 1
* deal with comments
* deal with comments
* fixed readme
* deal with comments
* add all platform shell
* Update config.arm.txt
* Update config.gpu.txt
* Update config.x86.txt
* fixed printinfo bug
* rm proxy
* add more model support
* all backend config.txt
* deal with comments
* Add MattingDiff compare
* fixed predict bug
* adjust warmup/repeat times
* add e2e/mem configs
* fixed typo
* open collect_mem
* fixed typo
* add trt cache option
* fixed bug
* fixed repeat times
* test for benchmark
* test for det benchmark
* for benchmark
* fixed for x86
* add h2d and d2h config
* renmae txt file
* add dynamic shape for pp_trt
* fixed typo
* Update option.h
* add collect shape
* add default value for SetShape()
---------
Co-authored-by: DefTruth <31974251+DefTruth@users.noreply.github.com >
2023-03-27 14:03:47 +08:00
ChaoII
d43e9011eb
[Bug Fix]fix tracking 'LetterBoxResize' ( #1711 )
2023-03-27 14:03:09 +08:00
WJJ1995
5c70db176f
[Backend]Add switch_ir_debug for Paddle Backend ( #1700 )
...
* avoid mem copy for cpp benchmark
* set CMAKE_BUILD_TYPE to Release
* Add SegmentationDiff
* change pointer to reference
* fixed bug
* cast uint8 to int32
* Add diff compare for OCR
* Add diff compare for OCR
* rm ppocr pipeline
* Add yolov5 diff compare
* Add yolov5 diff compare
* deal with comments
* deal with comments
* fixed bug
* fixed bug
* fixed thread nums
* Add Failed log
* optimizer x86 pipeline
* Add switch_ir_debug for paddle backend
* fixed for ci
2023-03-24 17:29:31 +08:00
guxukai
631f94d276
[CVCUDA] Update CV-CUDA to v0.2.1, add vision processor C++ tutorial ( #1678 )
...
* update cvcuda 0.2.0 -> 0.2.1
* add cpp tutorials demo
* fix reviewed problem
2023-03-24 16:57:35 +08:00
yeliang2258
cae341e6c5
[Backend] Add fp16 support for ONNXRuntime-GPU ( #1239 )
...
* add fp16 support for ort-gpu
* add enable_ort_fp16 option
* fix
* fix bugs
* use fp16 for test
* update code
* update code
* fix windows bug
2023-03-23 18:23:13 +08:00
yunyaoXYY
b3e16e9966
ORT support UINT8 and INT8 input and output
2023-03-21 02:23:23 +00:00
Jack Zhou
012c7771c1
[Serving] Add collect shape and fix serving infer ( #1658 )
...
Add collect shape and fix serving infer
2023-03-20 19:55:30 +08:00
DefTruth
6af3691568
[XPU] Update Lite XPU lib and fixed some bugs ( #1647 )
2023-03-17 21:39:39 +08:00
guxukai
4d57b62f83
[Doc] add vision processors cpp api doc ( #1624 )
...
* add vision processors cpp api doc
* add base class Processor in api doc
* Update base.h
---------
Co-authored-by: Wang Xinyu <shaywxy@gmail.com >
2023-03-17 13:20:38 +08:00
Jason
3b1343c726
[Bug] Fix loadding big model loadding problem ( #1636 )
...
Fix loadding big model loadding problem
2023-03-17 10:25:26 +08:00
Ethan Yang
4f48d84c27
[Backend] optimize cpu usage on openvino backend ( #1531 )
...
* optimiza cpu usage on openvino backend
conver the hint varible to string
* update with affinity mode set-up
---------
Co-authored-by: Ethan <yicheng@intel.com >
Co-authored-by: Jason <jiangjiajun@baidu.com >
2023-03-17 10:24:25 +08:00
WJJ1995
a598e7adc4
[Benchmark]Add MattingResult Compare ( #1619 )
...
* add GPL lisence
* add GPL-3.0 lisence
* add GPL-3.0 lisence
* add GPL-3.0 lisence
* support yolov8
* add pybind for yolov8
* add yolov8 readme
* add cpp benchmark
* add cpu and gpu mem
* public part split
* add runtime mode
* fixed bugs
* add cpu_thread_nums
* deal with comments
* deal with comments
* deal with comments
* rm useless code
* add FASTDEPLOY_DECL
* add FASTDEPLOY_DECL
* fixed for windows
* mv rss to pss
* mv rss to pss
* Update utils.cc
* use thread to collect mem
* Add ResourceUsageMonitor
* rm useless code
* fixed bug
* fixed typo
* update ResourceUsageMonitor
* fixed bug
* fixed bug
* add note for ResourceUsageMonitor
* deal with comments
* add macros
* deal with comments
* deal with comments
* deal with comments
* re-lint
* rm pmap and use mem api
* rm pmap and use mem api
* add mem api
* Add PrintBenchmarkInfo func
* Add PrintBenchmarkInfo func
* Add PrintBenchmarkInfo func
* deal with comments
* fixed enable_paddle_to_trt
* add log for paddle_trt
* support ppcls benchmark
* use new trt option api
* update benchmark info
* simplify benchmark.cc
* simplify benchmark.cc
* deal with comments
* Add ppseg && ppocr benchmark
* add OCR rec img
* add ocr benchmark
* fixed trt shape
* add trt shape
* resolve conflict
* add ENABLE_BENCHMARK define
* Add ClassifyDiff
* Add Resize for ClassifyResult
* deal with comments
* add convert info script
* resolve conflict
* Add SaveBenchmarkResult func
* fixed bug
* fixed bug
* fixed bug
* add config.txt for option
* fixed bug
* fixed bug
* fixed bug
* add benchmark.sh
* mv thread_nums from 8 to 1
* deal with comments
* deal with comments
* fixed readme
* deal with comments
* add all platform shell
* Update config.arm.txt
* Update config.gpu.txt
* Update config.x86.txt
* fixed printinfo bug
* rm proxy
* add more model support
* all backend config.txt
* deal with comments
* Add MattingDiff compare
* fixed predict bug
---------
Co-authored-by: DefTruth <31974251+DefTruth@users.noreply.github.com >
2023-03-15 17:41:19 +08:00
Jack Zhou
c73e2ad093
Merge pull request #1615 from joey12300/remove_bind_output_tensor_info
...
[Backend] Remove FDINFO in BindOutputTensor
2023-03-14 21:58:47 +08:00
zhoushunjie
b7fb3aff08
remoove fdinfo in BindOutputTensor
2023-03-14 12:53:37 +00:00
guxukai
ab38c9110f
[CVCUDA]add op Python API: Cast, HWC2CHW, Normalize, PadToSize, Resize, StridePad ( #1589 )
...
* add Cast, HWC2CHW, Normalize, PadToSize, StridePad
* add comments
* fix comments
* fix manager.cc
2023-03-14 19:16:07 +08:00
Jason
3d36e26b8a
[Backend] Remove some deprecated api ( #1574 )
...
Remove some deprecated api
2023-03-13 13:42:43 +08:00
guxukai
c6480de736
[CVCUDA] Vision Processor Python API and Tutorial ( #1394 )
...
* bind success
* bind success fix
* FDMat pybind, ResizeByShort pybind
* FDMat pybind, ResizeByShort pybind, remove initialized_
* override BindProcessorManager::Run in python is available
* PyProcessorManager done
* vision_pybind fix
* manager.py fix
* add tutorials
* remove Apply() bind
* remove Apply() bind and fix
* fix reviewed problem
* fix reviewed problem
* fix reviewed problem readme
* fix reviewed problem readme etc
* apply return outputs
* nits
* update readme
* fix FDMatbatch
* add op pybind: CenterCrop, Pad
* add op overload for pass FDMatBatch
---------
Co-authored-by: Wang Xinyu <shaywxy@gmail.com >
2023-03-10 14:42:32 +08:00
Wang Xinyu
cb7c8a07d4
[CVCUDA] PaddleDetection preprocessor support CV-CUDA ( #1493 )
...
* ppdet preproc use manager
* pad_to_size chw opencv
* pad_to_size chw flycv
* fix pad_to_size flycv
* add warning message
* cvcuda convert cubic to linear, padToSize cvcuda
* stridedpad cvcuda
* fix flycv include
* fix flycv include
* fix flycv build
* cast cvcuda
* fix pybind
* fix normalize permute cuda
* base processor move funcs to cc
* Update pad_to_size.cc
2023-03-10 12:43:57 +08:00
heliqi
a14480ae2b
Update fd_tensor.cc ( #1561 )
2023-03-10 09:08:38 +08:00
Jack Zhou
f4736e7931
Merge pull request #1552 from joey12300/fix_delete_pass
...
[Backend] Fix delete pass of paddle inference
2023-03-08 19:57:08 +08:00
Jason
6be2c0367b
[Example] Update runtime examples ( #1542 )
...
* Add notes for tensors
* Optimize some apis
* move some warnings
2023-03-08 16:56:04 +08:00
zhoushunjie
384eca14fd
Fix delete pass
2023-03-08 06:32:27 +00:00
Zheng-Bicheng
0687d3b0ad
[Model] Add Solov2 For PaddleDetection ( #1435 )
...
* update solov2
* Repair note
* update solov2 postprocess
* update
* update solov2
* update solov2
* fixed bug
* fixed bug
* update solov2
* update solov2
* fix build android bug
* update docs
* update docs
* update docs
* update
* update
* update arch and docs
* update
* update
* update solov2 python
---------
Co-authored-by: DefTruth <31974251+DefTruth@users.noreply.github.com >
2023-03-08 10:01:32 +08:00
shirukai
96a3698271
[Model] Support size param to ResizeImage preprocessor ( #1527 )
...
feat: ResizeImage函数新增支持按照size处理图片
2023-03-08 09:53:33 +08:00
Jason
7e4ef4a72c
Merge branch 'develop' into rknn_pybind
2023-03-07 18:53:53 +08:00
Jason
8ec1353cd8
[Doc] Add notes for tensors ( #1533 )
...
Add notes for tensors
2023-03-07 18:46:48 +08:00
Zheng-Bicheng
458523fc29
update pybind
2023-03-07 15:50:49 +08:00
WJJ1995
99b1bc5d6e
[Benchmark] Add run_benchmark_cpu.sh ( #1465 )
...
* add GPL lisence
* add GPL-3.0 lisence
* add GPL-3.0 lisence
* add GPL-3.0 lisence
* support yolov8
* add pybind for yolov8
* add yolov8 readme
* add cpp benchmark
* add cpu and gpu mem
* public part split
* add runtime mode
* fixed bugs
* add cpu_thread_nums
* deal with comments
* deal with comments
* deal with comments
* rm useless code
* add FASTDEPLOY_DECL
* add FASTDEPLOY_DECL
* fixed for windows
* mv rss to pss
* mv rss to pss
* Update utils.cc
* use thread to collect mem
* Add ResourceUsageMonitor
* rm useless code
* fixed bug
* fixed typo
* update ResourceUsageMonitor
* fixed bug
* fixed bug
* add note for ResourceUsageMonitor
* deal with comments
* add macros
* deal with comments
* deal with comments
* deal with comments
* re-lint
* rm pmap and use mem api
* rm pmap and use mem api
* add mem api
* Add PrintBenchmarkInfo func
* Add PrintBenchmarkInfo func
* Add PrintBenchmarkInfo func
* deal with comments
* fixed enable_paddle_to_trt
* add log for paddle_trt
* support ppcls benchmark
* use new trt option api
* update benchmark info
* simplify benchmark.cc
* simplify benchmark.cc
* deal with comments
* Add ppseg && ppocr benchmark
* add OCR rec img
* add ocr benchmark
* fixed trt shape
* add trt shape
* resolve conflict
* add ENABLE_BENCHMARK define
* Add ClassifyDiff
* Add Resize for ClassifyResult
* deal with comments
* add convert info script
* resolve conflict
* Add SaveBenchmarkResult func
* fixed bug
* fixed bug
* fixed bug
* add config.txt for option
* fixed bug
* fixed bug
* fixed bug
* add benchmark.sh
* mv thread_nums from 8 to 1
* deal with comments
* deal with comments
* fixed readme
* deal with comments
---------
Co-authored-by: DefTruth <31974251+DefTruth@users.noreply.github.com >
2023-03-02 19:11:21 +08:00
yunyaoXYY
53ad450227
Merge pull request #1448 from yunyaoXYY/develop
...
[Other] Improve the Predict Interface of PP-OCR models.
2023-03-02 14:20:25 +08:00
Wang Xinyu
044ab993d2
[CVCUDA] PP-OCR Cls & Rec preprocessor support CV-CUDA ( #1470 )
...
* ppocr cls preprocessor use manager
* hwc2chw cvcuda
* ppocr rec preproc use manager
* ocr rec preproc cvcuda
* fix rec preproc bug
* ppocr cls&rec preproc set normalize
* fix pybind
* address comment
2023-03-02 10:50:44 +08:00
Zheng-Bicheng
610b4c532b
[Bug Fix] fixed rknn bugs ( #1468 )
...
fixed rknn bugs
2023-03-01 10:21:58 +08:00
yunyaoXYY
803521002f
Merge branch 'develop' of https://github.com/PaddlePaddle/FastDeploy into develop
2023-02-28 08:01:36 +00:00
yunyaoXYY
d09fbd861e
Improve interface
2023-02-28 07:51:22 +00:00
WJJ1995
fe9aff15f2
[Benchmark] Add SaveBenchmarkResult func for benchmark ( #1442 )
...
* add GPL lisence
* add GPL-3.0 lisence
* add GPL-3.0 lisence
* add GPL-3.0 lisence
* support yolov8
* add pybind for yolov8
* add yolov8 readme
* add cpp benchmark
* add cpu and gpu mem
* public part split
* add runtime mode
* fixed bugs
* add cpu_thread_nums
* deal with comments
* deal with comments
* deal with comments
* rm useless code
* add FASTDEPLOY_DECL
* add FASTDEPLOY_DECL
* fixed for windows
* mv rss to pss
* mv rss to pss
* Update utils.cc
* use thread to collect mem
* Add ResourceUsageMonitor
* rm useless code
* fixed bug
* fixed typo
* update ResourceUsageMonitor
* fixed bug
* fixed bug
* add note for ResourceUsageMonitor
* deal with comments
* add macros
* deal with comments
* deal with comments
* deal with comments
* re-lint
* rm pmap and use mem api
* rm pmap and use mem api
* add mem api
* Add PrintBenchmarkInfo func
* Add PrintBenchmarkInfo func
* Add PrintBenchmarkInfo func
* deal with comments
* fixed enable_paddle_to_trt
* add log for paddle_trt
* support ppcls benchmark
* use new trt option api
* update benchmark info
* simplify benchmark.cc
* simplify benchmark.cc
* deal with comments
* Add ppseg && ppocr benchmark
* add OCR rec img
* add ocr benchmark
* fixed trt shape
* add trt shape
* resolve conflict
* add ENABLE_BENCHMARK define
* Add ClassifyDiff
* Add Resize for ClassifyResult
* deal with comments
* add convert info script
* resolve conflict
* Add SaveBenchmarkResult func
* fixed bug
* fixed bug
* fixed bug
---------
Co-authored-by: DefTruth <31974251+DefTruth@users.noreply.github.com >
2023-02-28 11:55:22 +08:00
DefTruth
e86905ca0d
[Bug Fix] move enable_valid_backend_check option -> runtime_option ( #1450 )
...
* [Model] Add skip valid backend check option -> FastDeployModel
* [Model] Add skip valid backend check option -> FastDeployModel
* [Model] Add skip valid backend check option -> FastDeployModel
* [FastDeploy] move enable_valid_backend_check option -> runtime_option
2023-02-28 09:57:31 +08:00
DefTruth
7e5e690367
[Model] Add skip valid backend check option -> FastDeployModel ( #1445 )
...
* [Model] Add skip valid backend check option -> FastDeployModel
* [Model] Add skip valid backend check option -> FastDeployModel
* [Model] Add skip valid backend check option -> FastDeployModel
2023-02-27 15:37:01 +08:00
Zheng-Bicheng
8c3ccc2cc2
[Hackathon 182 Model] Update PPOCRV3 For RKNPU2 ( #1403 )
...
* update ppocrv3 for rknpu2
* add config
* add config
* detele unuseful
* update useful results
* Repair note
* Repair note
* fixed bugs
* update
2023-02-27 15:01:17 +08:00
Zheng-Bicheng
8e50fa307c
[Bug Fix] Fixed the segment error during the visualization of the detection model ( #1420 )
...
fixed detection bug
2023-02-25 12:49:38 +08:00
Jack Zhou
524c85745b
[Backend] Add fixed size optimization for transformer model ( #1430 )
...
Add enable_fixed_size_opt flag
2023-02-24 09:45:04 +08:00
WJJ1995
d3845eb4e1
[Benchmark]Compare diff for OCR ( #1415 )
...
* avoid mem copy for cpp benchmark
* set CMAKE_BUILD_TYPE to Release
* Add SegmentationDiff
* change pointer to reference
* fixed bug
* cast uint8 to int32
* Add diff compare for OCR
* Add diff compare for OCR
* rm ppocr pipeline
* Add yolov5 diff compare
* Add yolov5 diff compare
* deal with comments
* deal with comments
* fixed bug
* fixed bug
2023-02-23 18:57:39 +08:00
Jason
0c664fd006
[Other] Fix some memory leak problem ( #1422 )
...
* Fix memory leak problem for paddleseg model
* Fix bug
* Update postprocessor.cc
---------
Co-authored-by: root <root@bjyz-sys-gpu-kongming3.bjyz.baidu.com >
2023-02-23 16:03:40 +08:00
Jason
062b4fd327
[Bug Fix] Fix memory leak problem for paddleseg model ( #1421 )
...
Fix memory leak problem for paddleseg model
Co-authored-by: root <root@bjyz-sys-gpu-kongming3.bjyz.baidu.com >
2023-02-23 12:45:25 +08:00
