Improving corpus annotation productivity: a method and experiment with interactive tagging

Atro Voutilainen


Abstract
Corpus linguistic and language technological research needs empirical corpus data with nearly correct annotation and high volume to enable advances in language modelling and theorising. Recent work on improving corpus annotation accuracy presents semiautomatic methods to correct some of the analysis errors in available annotated corpora, while leaving the remaining errors undetected in the annotated corpus. We review recent advances in linguistics-based partial tagging and parsing, and regard the achieved analysis performance as sufficient for reconsidering a previously proposed method: combining nearly correct but partial automatic analysis with a minimal amount of human postediting (disambiguation) to achieve nearly correct corpus annotation accuracy at a competitive annotation speed. We report a pilot experiment with morphological (part-of-speech) annotation using a partial linguistic tagger of a kind previously reported with a very attractive precision-recall ratio, and observe that a desired level of annotation accuracy can be reached by using human disambiguation for less than 10\% of the words in the corpus.
Anthology ID:
L12-1200
Volume:
Proceedings of the Eighth International Conference on Language Resources and Evaluation (LREC'12)
Month:
May
Year:
2012
Address:
Istanbul, Turkey
Venue:
LREC
SIG:
Publisher:
European Language Resources Association (ELRA)
Note:
Pages:
2097–2102
Language:
URL:
http://www.lrec-conf.org/proceedings/lrec2012/pdf/393_Paper.pdf
DOI:
Bibkey:
Cite (ACL):
Atro Voutilainen. 2012. Improving corpus annotation productivity: a method and experiment with interactive tagging. In Proceedings of the Eighth International Conference on Language Resources and Evaluation (LREC'12), pages 2097–2102, Istanbul, Turkey. European Language Resources Association (ELRA).
Cite (Informal):
Improving corpus annotation productivity: a method and experiment with interactive tagging (Voutilainen, LREC 2012)
Copy Citation:
PDF:
http://www.lrec-conf.org/proceedings/lrec2012/pdf/393_Paper.pdf