Commit Graph

27 Commits

Author SHA1 Message Date
DefTruth
2ff7b10adc [cmake] switch paddle 2.4-dev7 -> 2.4-dev6 for windows (#1660)
* [cmake] switch paddle 2.4-dev7 -> 2.4-dev6 for windows

* [cmake] remove examples from install policy

* Update CMakeLists.txt
2023-03-21 10:41:34 +08:00
WJJ1995
1b37cb0c03 [Benchmark]Add End2End and meminfo configs (#1645)
* add GPL lisence

* add GPL-3.0 lisence

* add GPL-3.0 lisence

* add GPL-3.0 lisence

* support yolov8

* add pybind for yolov8

* add yolov8 readme

* add cpp benchmark

* add cpu and gpu mem

* public part split

* add runtime mode

* fixed bugs

* add cpu_thread_nums

* deal with comments

* deal with comments

* deal with comments

* rm useless code

* add FASTDEPLOY_DECL

* add FASTDEPLOY_DECL

* fixed for windows

* mv rss to pss

* mv rss to pss

* Update utils.cc

* use thread to collect mem

* Add ResourceUsageMonitor

* rm useless code

* fixed bug

* fixed typo

* update ResourceUsageMonitor

* fixed bug

* fixed bug

* add note for ResourceUsageMonitor

* deal with comments

* add macros

* deal with comments

* deal with comments

* deal with comments

* re-lint

* rm pmap and use mem api

* rm pmap and use mem api

* add mem api

* Add PrintBenchmarkInfo func

* Add PrintBenchmarkInfo func

* Add PrintBenchmarkInfo func

* deal with comments

* fixed enable_paddle_to_trt

* add log for paddle_trt

* support ppcls benchmark

* use new trt option api

* update benchmark info

* simplify benchmark.cc

* simplify benchmark.cc

* deal with comments

* Add ppseg && ppocr benchmark

* add OCR rec img

* add ocr benchmark

* fixed trt shape

* add trt shape

* resolve conflict

* add ENABLE_BENCHMARK define

* Add ClassifyDiff

* Add Resize for ClassifyResult

* deal with comments

* add convert info script

* resolve conflict

* Add SaveBenchmarkResult func

* fixed bug

* fixed bug

* fixed bug

* add config.txt for option

* fixed bug

* fixed bug

* fixed bug

* add benchmark.sh

* mv thread_nums from 8 to 1

* deal with comments

* deal with comments

* fixed readme

* deal with comments

* add all platform shell

* Update config.arm.txt

* Update config.gpu.txt

* Update config.x86.txt

* fixed printinfo bug

* rm proxy

* add more model support

* all backend config.txt

* deal with comments

* Add MattingDiff compare

* fixed predict bug

* adjust warmup/repeat times

* add e2e/mem configs

* fixed typo

---------

Co-authored-by: DefTruth <31974251+DefTruth@users.noreply.github.com>
2023-03-17 17:30:47 +08:00
Jason
6343b0db47 [Build] Support build with source code of Paddle2ONNX (#1559)
* Add notes for tensors

* Optimize some apis

* move some warnings

* Support build with Paddle2ONNX

* Add protobuf support

* Fix compile on mac

* add clearn package script

* Add paddle2onnx code

* remove submodule

* Add onnx ocde

* remove softlink

* add onnx code

* fix error

* Add cmake file

* fix patchelf

* update paddle2onnx

* Delete .gitmodules

---------

Co-authored-by: PaddleCI <paddle_ci@example.com>
Co-authored-by: pangyoki <pangyoki@126.com>
Co-authored-by: jiangjiajun <jiangjiajun@baidu.lcom>
2023-03-17 10:03:22 +08:00
zhoushunjie
8489e22b4b update paddle inference to 2.4-dev7 2023-03-14 09:56:16 +00:00
Jack Zhou
f7ef464412 [Other] Use symbolic link pointed to TensorRT library (#1461)
* Add force rpath

* update to dev-6

* remove force-rpath

* remove nvinfer so

* Add symbol link creation when import fastdeploy first

* Add dst

* update symbol link creation

* Add logging

* logging -> logger

* update tips

* Set logging level

* Add --force-rpath
2023-03-10 09:09:04 +08:00
Jason
bf2ba72f1b [Compile] Support build FastDeploy with GLIBCXX_ABI=0 (#1528)
* Support abi=0 build

* trigger ci

* fix cmake
2023-03-07 09:45:30 +08:00
Jack Zhou
e63f5f369e [Backend] Update paddle inference to 2.4-dev5 (#1302)
update paddle inference to 2.4-dev5
2023-02-12 15:13:39 +08:00
WJJ1995
aa6931bee9 [Model] Add YOLOv5-seg (#988)
* add onnx_ort_runtime demo

* rm in requirements

* support batch eval

* fixed MattingResults bug

* move assignment for DetectionResult

* integrated x2paddle

* add model convert readme

* update readme

* re-lint

* add processor api

* Add MattingResult Free

* change valid_cpu_backends order

* add ppocr benchmark

* mv bs from 64 to 32

* fixed quantize.md

* fixed quantize bugs

* Add Monitor for benchmark

* update mem monitor

* Set trt_max_batch_size default 1

* fixed ocr benchmark bug

* support yolov5 in serving

* Fixed yolov5 serving

* Fixed postprocess

* update yolov5 to 7.0

* add poros runtime demos

* update readme

* Support poros abi=1

* rm useless note

* deal with comments

* support pp_trt for ppseg

* fixed symlink problem

* Add is_mini_pad and stride for yolov5

* Add yolo series for paddle format

* fixed bugs

* fixed bug

* support yolov5seg

* fixed bug

* refactor yolov5seg

* fixed bug

* mv Mask int32 to uint8

* add yolov5seg example

* rm log info

* fixed code style

* add yolov5seg example in python

* fixed dtype bug

* update note

* deal with comments

* get sorted index

* add yolov5seg test case

* Add GPL-3.0 License

* add round func

* deal with comments

* deal with commens

Co-authored-by: Jason <jiangjiajun@baidu.com>
2023-01-11 15:36:32 +08:00
Jason
df20b2a02b [Other] Remove useless macros (#1095)
* Remove useless macros

* triger ci

* fix check error

* rename INTEGRATE_PADDLE2ONNX to ENABLE_PADDLE2ONNX
2023-01-09 21:35:23 +08:00
Jason
af2ceff857 [Compile] Support build on jetson without python (#1045)
support jetson build
2023-01-04 10:53:12 +08:00
Jason
f038268c79 [Bug Fix] Fix build with Paddle Inference on Jetson (#1019)
Fix build with Paddle Inference on Jetson
2022-12-30 15:06:13 +08:00
Jack Zhou
9795a5287d [Backend] Update paddle inference version (#990)
2.4-dev3 -> 2.4-dev4
2022-12-29 15:50:45 +08:00
Jason
b0988bf423 [Compile] Support custom paddle inference (#839)
* Support custom paddle inference

* update setup.py
2022-12-09 11:41:19 +08:00
Jack Zhou
647d6117f5 [Backend] Return paddle inference back to dev3 version (#824)
back_to_dev3
2022-12-07 21:18:20 +08:00
zhoushunjie
d3bf594493 Update paddle inference version 2022-12-05 10:49:54 +00:00
Hao Guan
d8d030b02f [osx] detect cross compiling architecture (#712) 2022-11-28 11:26:19 +08:00
Jason
c76992c906 [Backend] Fix version of Paddle Inference with IPU (#467)
Fix version of Paddle Inference with IPU
2022-11-01 10:13:44 +08:00
Jack Zhou
f2747133d6 [Quantization] Update the paddle inference library to support quantization (#455)
Update the paddle inference version in linux x64 gpu, windows gpu

Co-authored-by: Jason <jiangjiajun@baidu.com>
2022-10-31 16:33:34 +08:00
czr-gc
ede59af857 [Backend] support ipu in paddle inference backend. (#437)
* feat(ipu): add ipu support for paddle_infer backend.

* fix(): remove unused env.

* fix(ipu): simplify user API for IPU.

* fix(cmake): fix merge conflict error in CMakeList.

Co-authored-by: Jason <jiangjiajun@baidu.com>
2022-10-30 18:59:59 +08:00
Jack Zhou
173bbf5af4 [Backend] Integrate TensorRT in Paddle Inference backend by default (#381)
* Modify filter of trt

* Add Note for trt libs

* Use paddle inference with trt package

Co-authored-by: Jason <jiangjiajun@baidu.com>
2022-10-18 15:29:06 +08:00
DefTruth
e24c592f43 [osx] fixed mac osx arm64 and x86_64 0.3.0 rpath error (#374)
* Update paddle_inference.cmake

* Update process_libraries.py.in

* Update process_libraries.py.in

* Update paddle_inference.cmake

* Update CMakeLists.txt

* Update VERSION_NUMBER

* Update VERSION_NUMBER

* Update download_prebuilt_libraries.md

* Update gpu.md

* Update cpu.md

* Update download_prebuilt_libraries.md

* Update jetson.md

* Update tensorrt_tricks.md

* Update cpp.md

Co-authored-by: Jason <jiangjiajun@baidu.com>
2022-10-16 15:23:35 +08:00
Jason
3ff562aa77 Bump up to version 0.3.0 (#371)
* Update VERSION_NUMBER

* Update paddle_inference.cmake

* Delete docs directory

* release new docs

* update version number

* add vision result doc

* update version

* fix dead link

* fix vision

* fix dead link

* Update README_EN.md

* Update README_EN.md

* Update README_EN.md

* Update README_EN.md

* Update README_EN.md

* Update README_CN.md

* Update README_EN.md

* Update README_CN.md

* Update README_EN.md

* Update README_CN.md

* Update README_EN.md

* Update README_EN.md

Co-authored-by: leiqing <54695910+leiqing1@users.noreply.github.com>
2022-10-15 22:01:27 +08:00
Jason
e6f8bd90cf Revert Paddle Inference to No TRT version (#355) 2022-10-12 19:39:37 +08:00
Jason
945e197bd1 Fix bug of get input/output information from PaddleBackend (#339)
* Fix bug of get input/output information from PaddleBackend

* Support Paddle Inference with TensorRT (#340)

* Fix bug
2022-10-12 11:37:26 +08:00
Jason
311a59c62d Add patchelf to solve the build problem on Linux without patchelf (#291)
* add patchelf as tool

* Update CMakeLists.txt
2022-09-28 10:48:49 +08:00
Jason
5046574b95 Fix bug for part of detection model (#243)
* fix error for part of detection model

* fix error for part of detection model

* add patch paddle inference
2022-09-16 16:31:34 +08:00
Jason
695034fdad Modify directory external and build_scripts name (#225)
modify directory name
2022-09-14 20:13:35 +08:00