Commit Graph

57 Commits

Author SHA1 Message Date
Jack Zhou
bae93cebc6 Add uie cpp deploy (#120)
* implement PredictUIEInput

* remove batch size

* Add GetCandidateIdx

* add GetCandidateIdx GetSpan GetSpanIdxAndProbs

* Add Predict of UIEModel

* Add relation schema

* Fix uie unicode bug

* rename information_extraction/ernie -> uie

* Add more uie task

* Add cross task extraction

* use CharToBytesOffsetConverter

* Add faster_tokenizer dir

* Add RuntimeOption args

* Add todo comments

* Add some readme

* fix readme

* Fix readme

Co-authored-by: Jason <jiangjiajun@baidu.com>
2022-08-24 20:20:47 +08:00
Jack Zhou
835bb39b10 Add ernie ie task (#100) 2022-08-15 13:28:48 +08:00
Jason
22ca63982b Refine code structure (#89)
* refine code structure

* refine code structure
2022-08-10 10:50:22 +08:00
Jack Zhou
c7d37b6732 Add reduce functions for FDTensor (#81)
* Add eigen tensor structure

* Add Reduce function

* Add cpp unittest framework

* Add reduce function unittest

* Add pr template

* Add comments and docs for reduce function

* Fix typo

* Add ENABLE_FDTENSOR_FUNC macro

* Add Todo comment

* Add CheckData overload

* Fix CheckData overload operator()

Co-authored-by: Jason <jiangjiajun@baidu.com>
2022-08-10 10:31:04 +08:00
Jack Zhou
32c2154bbe Unify the data type of tensor shape (#74)
int32_t->int64_t
2022-08-08 14:02:56 +08:00
Jack Zhou
0587c4bbac Add const Data of FDTensor (#72)
* Add const Data of FDTensor

* use SetExternalData instead of memcpy

* Add Softmax

* Add Max

* Add viterbi decode for ernie tokencls
2022-08-08 08:51:51 +08:00
Jack Zhou
d792af059a Add text examples (#69)
* Add text init file

* Fix some cmake

* Add TextModel, TextResult, PredictionOption

* Add text preprocessor, postprocessor, pipeline of text model prediction

* remove Text prefix

* Add faster_tokenizer deps

* Add ernie IE examples

* Add eigen computation

* eigen.h->compute.h

* Add python ernie examples

* Fix some comments
2022-08-05 15:24:02 +08:00