Jack Zhou
|
524c85745b
|
[Backend] Add fixed size optimization for transformer model (#1430)
Add enable_fixed_size_opt flag
|
2023-02-24 09:45:04 +08:00 |
|
Jason
|
dd527388bc
|
Update option.h
|
2023-02-22 11:28:04 +08:00 |
|
Jason
|
18e33bae5c
|
[Other] Optimize runtime module (#1356)
* Optimize runtime
* fix error
* [Backend] Add option to print tensorrt conversion log (#1386)
Add option to print tensorrt conversion log
Co-authored-by: root <root@bjyz-sys-gpu-kongming3.bjyz.baidu.com>
---------
Co-authored-by: root <root@bjyz-sys-gpu-kongming3.bjyz.baidu.com>
|
2023-02-21 17:01:32 +08:00 |
|
WJJ1995
|
b6658b8094
|
[Benchmark] Add ppocr && ppseg benchmark (#1344)
* add GPL lisence
* add GPL-3.0 lisence
* add GPL-3.0 lisence
* add GPL-3.0 lisence
* support yolov8
* add pybind for yolov8
* add yolov8 readme
* add cpp benchmark
* add cpu and gpu mem
* public part split
* add runtime mode
* fixed bugs
* add cpu_thread_nums
* deal with comments
* deal with comments
* deal with comments
* rm useless code
* add FASTDEPLOY_DECL
* add FASTDEPLOY_DECL
* fixed for windows
* mv rss to pss
* mv rss to pss
* Update utils.cc
* use thread to collect mem
* Add ResourceUsageMonitor
* rm useless code
* fixed bug
* fixed typo
* update ResourceUsageMonitor
* fixed bug
* fixed bug
* add note for ResourceUsageMonitor
* deal with comments
* add macros
* deal with comments
* deal with comments
* deal with comments
* re-lint
* rm pmap and use mem api
* rm pmap and use mem api
* add mem api
* Add PrintBenchmarkInfo func
* Add PrintBenchmarkInfo func
* Add PrintBenchmarkInfo func
* deal with comments
* fixed enable_paddle_to_trt
* add log for paddle_trt
* support ppcls benchmark
* use new trt option api
* update benchmark info
* simplify benchmark.cc
* simplify benchmark.cc
* deal with comments
* Add ppseg && ppocr benchmark
* add OCR rec img
* add ocr benchmark
* fixed trt shape
* add trt shape
* resolve conflict
* add ENABLE_BENCHMARK define
---------
Co-authored-by: DefTruth <31974251+DefTruth@users.noreply.github.com>
|
2023-02-20 15:59:27 +08:00 |
|
WJJ1995
|
c25d1cc1bc
|
[Backend]Fixed enable_paddle_to_trt() bug (#1320)
* add GPL lisence
* add GPL-3.0 lisence
* add GPL-3.0 lisence
* add GPL-3.0 lisence
* support yolov8
* add pybind for yolov8
* add yolov8 readme
* add cpp benchmark
* add cpu and gpu mem
* public part split
* add runtime mode
* fixed bugs
* add cpu_thread_nums
* deal with comments
* deal with comments
* deal with comments
* rm useless code
* add FASTDEPLOY_DECL
* add FASTDEPLOY_DECL
* fixed for windows
* mv rss to pss
* mv rss to pss
* Update utils.cc
* use thread to collect mem
* Add ResourceUsageMonitor
* rm useless code
* fixed bug
* fixed typo
* update ResourceUsageMonitor
* fixed bug
* fixed bug
* add note for ResourceUsageMonitor
* deal with comments
* add macros
* deal with comments
* deal with comments
* deal with comments
* re-lint
* rm pmap and use mem api
* rm pmap and use mem api
* add mem api
* Add PrintBenchmarkInfo func
* Add PrintBenchmarkInfo func
* Add PrintBenchmarkInfo func
* deal with comments
* fixed enable_paddle_to_trt
* add log for paddle_trt
---------
Co-authored-by: DefTruth <31974251+DefTruth@users.noreply.github.com>
|
2023-02-14 17:51:39 +08:00 |
|
wwbitejotunn
|
f1ab47a4ef
|
code revine
|
2023-02-13 18:16:45 +00:00 |
|
wwbitejotunn
|
289d353d99
|
Merge branch 'develop' of https://github.com/paddlepaddle/fastdeploy into set_stream_infer-shareExData
|
2023-02-13 03:14:18 +00:00 |
|
wwbitejotunn
|
abfa9fd850
|
prebind output by shareExternalData
|
2023-02-13 03:11:31 +00:00 |
|
wwbitejotunn
|
898b063216
|
get cache dir
|
2023-02-09 20:56:55 +08:00 |
|
wwbitejotunn
|
c2e5f6317e
|
fix paddle backend
|
2023-02-09 20:56:55 +08:00 |
|
wwbitejotunn
|
4b293a89de
|
fix paddle backend
|
2023-02-09 05:51:30 +00:00 |
|
Jason
|
b8afb0d040
|
[Other] Move comments for deprecated functions (#1275)
Move comments for deprecated functions
|
2023-02-09 10:04:18 +08:00 |
|
Jason
|
a4b0565b9a
|
[Other] Optimize paddle backend (#1265)
* Optimize paddle backend
* optimize paddle backend
* add version support
|
2023-02-08 19:12:03 +08:00 |
|
DefTruth
|
f73a538f61
|
[Backend] support bechmark mode for runtime and backend (#1201)
* [backend] support bechmark mode for runtime and backend
* [backend] support bechmark mode for runtime and backend
* [pybind11] add benchmark methods pybind
* [pybind11] add benchmark methods pybind
* [Other] Update build scripts
* [Other] Update cmake/summary.cmake
* [Other] update build scripts
* [Other] add ENABLE_BENCHMARK option -> setup.py
* optimize backend time recording
* optimize backend time recording
* optimize trt backend time record
* [backend] optimze backend_time recording for trt
* [benchmark] remove redundant logs
* fixed ov_backend confilct
* [benchmark] fixed paddle_backend conflicts
* [benchmark] fixed paddle_backend conflicts
* [benchmark] fixed paddle_backend conflicts
* [benchmark] remove use_gpu option from ort backend option
* [benchmark] update benchmark_ppdet.py
* [benchmark] update benchmark_ppcls.py
* fixed lite backend conflicts
* [Lite] fixed lite xpu
* add benchmark macro
* add RUNTIME_PROFILE_LOOP macros
* add comments for RUNTIME_PROFILE macros
* add comments for new apis
* add comments for new apis
* update benchmark_ppdet.py
* afixed bugs
* remove unused codes
* optimize RUNTIME_PROFILE_LOOP macros
* optimize RUNTIME_PROFILE_LOOP macros
* add comments for benchmark option and result
* add docs for benchmark namespace
|
2023-02-06 14:29:35 +08:00 |
|
huangjianhui
|
ba6d75f526
|
Delete redundant code (#1222)
Update paddle_backend.cc
Delete redundant code
Co-authored-by: Jason <jiangjiajun@baidu.com>
|
2023-02-02 15:44:52 +08:00 |
|
Jason
|
b4e322af63
|
[Other] Optimize load model from memory function (#1205)
Optimize option for runtime
|
2023-02-01 15:50:38 +08:00 |
|
huangjianhui
|
76df90afc3
|
[Other] FastDeploy TensorRT && ONNX backend support to load model form memory (#1130)
* Update all backends load model from buffer
* Delete redundant code
* Format code style
* Format code style
* Delete redundant code
* Delete redundant code
* Add some FDASSERTs
* Update load model form memory when cloning engine
* Update clone engine code
* Update set_model_buffer api parameters with char pointer
* Release memory buffer variables after finish init backends
* Fix conflict
* Fix bug
|
2023-02-01 11:36:09 +08:00 |
|
WJJ1995
|
aa6931bee9
|
[Model] Add YOLOv5-seg (#988)
* add onnx_ort_runtime demo
* rm in requirements
* support batch eval
* fixed MattingResults bug
* move assignment for DetectionResult
* integrated x2paddle
* add model convert readme
* update readme
* re-lint
* add processor api
* Add MattingResult Free
* change valid_cpu_backends order
* add ppocr benchmark
* mv bs from 64 to 32
* fixed quantize.md
* fixed quantize bugs
* Add Monitor for benchmark
* update mem monitor
* Set trt_max_batch_size default 1
* fixed ocr benchmark bug
* support yolov5 in serving
* Fixed yolov5 serving
* Fixed postprocess
* update yolov5 to 7.0
* add poros runtime demos
* update readme
* Support poros abi=1
* rm useless note
* deal with comments
* support pp_trt for ppseg
* fixed symlink problem
* Add is_mini_pad and stride for yolov5
* Add yolo series for paddle format
* fixed bugs
* fixed bug
* support yolov5seg
* fixed bug
* refactor yolov5seg
* fixed bug
* mv Mask int32 to uint8
* add yolov5seg example
* rm log info
* fixed code style
* add yolov5seg example in python
* fixed dtype bug
* update note
* deal with comments
* get sorted index
* add yolov5seg test case
* Add GPL-3.0 License
* add round func
* deal with comments
* deal with commens
Co-authored-by: Jason <jiangjiajun@baidu.com>
|
2023-01-11 15:36:32 +08:00 |
|
Jason
|
df20b2a02b
|
[Other] Remove useless macros (#1095)
* Remove useless macros
* triger ci
* fix check error
* rename INTEGRATE_PADDLE2ONNX to ENABLE_PADDLE2ONNX
|
2023-01-09 21:35:23 +08:00 |
|
Jason
|
4aa4ebd7c3
|
[Other] [Part2] Upgrade runtime module (#1080)
[Other] Upgrade runtime module
|
2023-01-09 13:22:51 +08:00 |
|