Temporal Annotation: A Proposal for Guidelines and an Experiment with Inter-annotator Agreement

André Bittar, Caroline Hagège, Véronique Moriceau, Xavier Tannier, Charles Teissèdre


Abstract
This article presents work carried out within the framework of the ongoing ANR (French National Research Agency) project Chronolines, which focuses on the temporal processing of large news-wire corpora in English and French. The aim of the project is to create new and innovative interfaces for visualizing textual content according to temporal criteria. Extracting and normalizing the temporal information in texts through linguistic annotation is an essential step towards attaining this objective. With this goal in mind, we developed a set of guidelines for the annotation of temporal and event expressions that is intended to be compatible with the TimeML markup language, while addressing some of its pitfalls. We provide results of an initial application of these guidelines to real news-wire texts in French over several iterations of the annotation process. These results include inter-annotator agreement figures and an error analysis. Our final inter-annotator agreement figures compare favorably with those reported for the TimeBank 1.2 annotation project.
Anthology ID:
L12-1142
Volume:
Proceedings of the Eighth International Conference on Language Resources and Evaluation (LREC'12)
Month:
May
Year:
2012
Address:
Istanbul, Turkey
Venue:
LREC
SIG:
Publisher:
European Language Resources Association (ELRA)
Note:
Pages:
3741–3745
Language:
URL:
http://www.lrec-conf.org/proceedings/lrec2012/pdf/308_Paper.pdf
DOI:
Bibkey:
Cite (ACL):
André Bittar, Caroline Hagège, Véronique Moriceau, Xavier Tannier, and Charles Teissèdre. 2012. Temporal Annotation: A Proposal for Guidelines and an Experiment with Inter-annotator Agreement. In Proceedings of the Eighth International Conference on Language Resources and Evaluation (LREC'12), pages 3741–3745, Istanbul, Turkey. European Language Resources Association (ELRA).
Cite (Informal):
Temporal Annotation: A Proposal for Guidelines and an Experiment with Inter-annotator Agreement (Bittar et al., LREC 2012)
Copy Citation:
PDF:
http://www.lrec-conf.org/proceedings/lrec2012/pdf/308_Paper.pdf