Abstract
This paper discusses the problem of utilising multiply annotated data in training biomedical information extraction systems. Two corpora, annotated with entities and relations, and containing a number of multiply annotated documents, are used to train named entity recognition and relation extraction systems. Several methods of automatically combining the multiple annotations to produce a single annotation are compared, but none produces better results than simply picking one of the annotated versions at random. It is also shown that adding extra singly annotated documents produces faster performance gains than adding extra multiply annotated documents.- Anthology ID:
- L08-1072
- Volume:
- Proceedings of the Sixth International Conference on Language Resources and Evaluation (LREC'08)
- Month:
- May
- Year:
- 2008
- Address:
- Marrakech, Morocco
- Venue:
- LREC
- SIG:
- Publisher:
- European Language Resources Association (ELRA)
- Note:
- Pages:
- Language:
- URL:
- http://www.lrec-conf.org/proceedings/lrec2008/pdf/516_paper.pdf
- DOI:
- Cite (ACL):
- Barry Haddow and Beatrice Alex. 2008. Exploiting Multiply Annotated Corpora in Biomedical Information Extraction Tasks. In Proceedings of the Sixth International Conference on Language Resources and Evaluation (LREC'08), Marrakech, Morocco. European Language Resources Association (ELRA).
- Cite (Informal):
- Exploiting Multiply Annotated Corpora in Biomedical Information Extraction Tasks (Haddow & Alex, LREC 2008)
- PDF:
- http://www.lrec-conf.org/proceedings/lrec2008/pdf/516_paper.pdf