[Model] Upgrade uie (#458)

* Upgrade uie c++ implement

* upgrade python UIEModel inherit FastDeployModel

* Add schema language support; Skip infer when no prompts

* Adjust the schema language arg pos

* Add schema_language for python and cpp

* update pybind for uie

* Fix the args of uie

* Add SchemaLanguage
This commit is contained in:
Jack Zhou
2022-10-30 17:04:05 +08:00
committed by GitHub
parent d70b6c99df
commit ee2c6136fc
8 changed files with 128 additions and 66 deletions

View File

@@ -329,7 +329,9 @@ fd.text.uie.UIEModel(model_file,
position_prob=0.5,
max_length=128,
schema=[],
runtime_option=None,model_format=ModelFormat.PADDLE)
runtime_option=None,
model_format=ModelFormat.PADDLE,
schema_language=SchemaLanguage.ZH)
```
UIEModel模型加载和初始化其中`model_file`, `params_file`为训练模型导出的Paddle inference文件具体请参考其文档说明[模型导出](https://github.com/PaddlePaddle/PaddleNLP/blob/develop/model_zoo/uie/README.md#%E6%A8%A1%E5%9E%8B%E9%83%A8%E7%BD%B2)`vocab_file`为词表文件UIE模型的词表可在[UIE配置文件](https://github.com/PaddlePaddle/PaddleNLP/blob/5401f01af85f1c73d8017c6b3476242fce1e6d52/model_zoo/uie/utils.py)中下载相应的UIE模型的vocab_file。
@@ -344,6 +346,7 @@ UIEModel模型加载和初始化其中`model_file`, `params_file`为训练模
> * **schema**(list|dict): 抽取任务的目标信息。
> * **runtime_option**(RuntimeOption): 后端推理配置默认为None即采用默认配置
> * **model_format**(ModelFormat): 模型格式默认为Paddle格式
> * **schema_language**(SchemaLanguage): Schema语言。默认为ZH中文目前支持的语言种类包括ZH中文EN英文
### set_schema函数

View File

@@ -12,7 +12,7 @@
# See the License for the specific language governing permissions and
# limitations under the License.
import fastdeploy
from fastdeploy.text import UIEModel
from fastdeploy.text import UIEModel, SchemaLanguage
import os
from pprint import pprint
@@ -80,7 +80,8 @@ if __name__ == "__main__":
position_prob=0.5,
max_length=128,
schema=schema,
runtime_option=runtime_option)
runtime_option=runtime_option,
schema_language=SchemaLanguage.ZH)
print("1. Named Entity Recognition Task")
print(f"The extraction schema: {schema}")