Learning a Unified Named Entity Tagger from Multiple Partially Annotated Corpora for Efficient Adaptation

Xiao Huang, Li Dong, Elizabeth Boschee, Nanyun Peng

Abstract
Named entity recognition (NER) identifies typed entity mentions in raw text. While the task is well-established, there is no universally used tagset: often, datasets are annotated for use in downstream applications and accordingly only cover a small set of entity types relevant to a particular task. For instance, in the biomedical domain, one corpus might annotate genes, another chemicals, and another diseases—despite the texts in each corpus containing references to all three types of entities. In this paper, we propose a deep structured model to integrate these “partially annotated” datasets to jointly identify all entity types appearing in the training corpora. By leveraging multiple datasets, the model can learn robust input representations; by building a joint structured model, it avoids potential conflicts caused by combining several models’ predictions at test time. Experiments show that the proposed model significantly outperforms strong multi-task learning baselines when training on multiple, partially annotated datasets and testing on datasets that contain tags from more than one of the training corpora.
Anthology ID:
K19-1048
Volume:
Proceedings of the 23rd Conference on Computational Natural Language Learning (CoNLL)
Month:
November
Year:
2019
Address:
Hong Kong, China
Venue:
CoNLL
SIG:
SIGNLL
Publisher:
Association for Computational Linguistics
Note:
Pages:
515–527
Language:
URL:
https://aclanthology.org/K19-1048
DOI:
10.18653/v1/K19-1048
Bibkey:
Cite (ACL):
Xiao Huang, Li Dong, Elizabeth Boschee, and Nanyun Peng. 2019. Learning a Unified Named Entity Tagger from Multiple Partially Annotated Corpora for Efficient Adaptation. In Proceedings of the 23rd Conference on Computational Natural Language Learning (CoNLL), pages 515–527, Hong Kong, China. Association for Computational Linguistics.
Cite (Informal):
Learning a Unified Named Entity Tagger from Multiple Partially Annotated Corpora for Efficient Adaptation (Huang et al., CoNLL 2019)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingestion-script-update/K19-1048.pdf
Supplementary material:
 K19-1048.Supplementary_Material.pdf
Attachment:
 K19-1048.Attachment.pdf
Code
 xhuang28/NewBioNer
Data
CoNLL-2003, WebKB
PDF Search Code Supplementary material Attachment