Temporal Annotation: A Proposal for Guidelines and an Experiment with Inter-annotator Agreement
André Bittar, Caroline Hagège, Véronique Moriceau, Xavier Tannier, Charles Teissèdre
Abstract
This article presents work carried out within the framework of the ongoing ANR (French National Research Agency) project Chronolines, which focuses on the temporal processing of large news-wire corpora in English and French. The aim of the project is to create new and innovative interfaces for visualizing textual content according to temporal criteria. Extracting and normalizing the temporal information in texts through linguistic annotation is an essential step towards attaining this objective. With this goal in mind, we developed a set of guidelines for the annotation of temporal and event expressions that is intended to be compatible with the TimeML markup language, while addressing some of its pitfalls. We provide results of an initial application of these guidelines to real news-wire texts in French over several iterations of the annotation process. These results include inter-annotator agreement figures and an error analysis. Our final inter-annotator agreement figures compare favorably with those reported for the TimeBank 1.2 annotation project.- Anthology ID:
- L12-1142
- Volume:
- Proceedings of the Eighth International Conference on Language Resources and Evaluation (LREC'12)
- Month:
- May
- Year:
- 2012
- Address:
- Istanbul, Turkey
- Editors:
- Nicoletta Calzolari, Khalid Choukri, Thierry Declerck, Mehmet Uğur Doğan, Bente Maegaard, Joseph Mariani, Asuncion Moreno, Jan Odijk, Stelios Piperidis
- Venue:
- LREC
- SIG:
- Publisher:
- European Language Resources Association (ELRA)
- Note:
- Pages:
- 3741–3745
- Language:
- URL:
- http://www.lrec-conf.org/proceedings/lrec2012/pdf/308_Paper.pdf
- DOI:
- Cite (ACL):
- André Bittar, Caroline Hagège, Véronique Moriceau, Xavier Tannier, and Charles Teissèdre. 2012. Temporal Annotation: A Proposal for Guidelines and an Experiment with Inter-annotator Agreement. In Proceedings of the Eighth International Conference on Language Resources and Evaluation (LREC'12), pages 3741–3745, Istanbul, Turkey. European Language Resources Association (ELRA).
- Cite (Informal):
- Temporal Annotation: A Proposal for Guidelines and an Experiment with Inter-annotator Agreement (Bittar et al., LREC 2012)
- PDF:
- http://www.lrec-conf.org/proceedings/lrec2012/pdf/308_Paper.pdf