apps/FastDeploy
1
0
Fork 0
mirror of https://github.com/PaddlePaddle/FastDeploy.git synced 2025-10-05 16:48:03 +08:00
Code Issues Actions 2 Packages Projects Releases Wiki Activity
Files
0dd9ecee65b16b2dcf72633b49af041a5e94dc55
FastDeploy/examples/text/uie/cpp
History
Jack Zhou 54bea3160d Add uie python api (#214) 
* add uie pybind

* Add uie result pybind

* Add uie python class

* fix UIEModel pythonargs

* Add schema node pybind

* remove uie print

* Fix cpp build ci
2022-09-13 19:03:06 +08:00
..
CMakeLists.txt
Move uie to fd (#166)
2022-08-29 21:31:09 +08:00
infer.cc
Add uie python api (#214)
2022-09-13 19:03:06 +08:00
README.md
Update README.md
2022-09-05 17:50:58 +08:00

README.md

通用信息抽取 UIE C++部署示例

本目录下提供infer.cc快速完成UIE模型在CPU/GPU的示例。

在部署前，需确认以下两个步骤

以Linux上uie-base模型推理为例，在本目录执行如下命令即可完成编译测试。

# UIE目前还未发布，当前需开发者自行编译FastDeploy，通过如下脚本编译得到部署库fastdeploy-linux-x64-dev
git clone https://github.com/PaddlePaddle/FastDeploy.git
cd FastDeploy
mkdir build && cd build
cmake .. -DENABLE_ORT_BACKEND=ON  \
               -DENABLE_VISION=ON \
               -DENABLE_PADDLE_BACKEND=ON \
               -DENABLE_TEXT=ON \
               -DWITH_GPU=ON \
               -DCMAKE_INSTALL_PREFIX=${PWD}/fastdeploy-linux-x64-gpu-dev

make -j8
make install

# 编译模型examples代码（SDK中包含了examples代码）
cd ../examples/text/uie/cpp
mkdir build
cd build
cmake .. -DFASTDEPLOY_INSTALL_DIR=${PWD}/../../../../../build/fastdeploy-linux-x64-gpu-dev
make -j

# 下载uie-base模型以及词表
wget https://bj.bcebos.com/fastdeploy/models/uie/uie-base.tgz
tar -xvfz uie-base.tgz


# CPU 推理
./infer_demo uie-base 0

# GPU 推理
./infer_demo uie-base 1

模型获取

UIE 模型介绍可以参考https://github.com/PaddlePaddle/PaddleNLP/tree/develop/model_zoo/uie 。其中，在完成训练后，需要将训练后的模型导出成推理模型。该步骤可参考该文档完成导出：https://github.com/PaddlePaddle/PaddleNLP/tree/develop/model_zoo/uie#%E6%A8%A1%E5%9E%8B%E9%83%A8%E7%BD%B2 。