Specifying Treebanks, Outsourcing Parsebanks: FinnTreeBank 3
Atro Voutilainen, Kristiina Muhonen, Tanja Purtonen, Krister Lindén
Abstract
Corpus-based treebank annotation is known to result in incomplete coverage of mid- and low-frequency linguistic constructions: the linguistic representation and corpus annotation quality are sometimes suboptimal. Large descriptive grammars cover also many mid- and low-frequency constructions. We argue for use of large descriptive grammars and their sample sentences as a basis for specifying higher-coverage grammatical representations. We present an sample case from an ongoing project (FIN-CLARIN FinnTreeBank) where an grammatical representation is documented as an annotator's manual alongside manual annotation of sample sentences extracted from a large descriptive grammar of Finnish. We outline the linguistic representation (morphology and dependency syntax) for Finnish, and show how the resulting `Grammar Definition Corpus' and the documentation is used as a task specification for an external subcontractor for building a parser engine for use in morphological and dependency syntactic analysis of large volumes of Finnish for parsebanking purposes. The resulting corpus, FinnTreeBank 3, is due for release in June 2012, and will contain tens of millions of words from publicly available corpora of Finnish with automatic morphological and dependency syntactic analysis, for use in research on the corpus linguistics and language engineering.- Anthology ID:
- L12-1448
- Volume:
- Proceedings of the Eighth International Conference on Language Resources and Evaluation (LREC'12)
- Month:
- May
- Year:
- 2012
- Address:
- Istanbul, Turkey
- Editors:
- Nicoletta Calzolari, Khalid Choukri, Thierry Declerck, Mehmet Uğur Doğan, Bente Maegaard, Joseph Mariani, Asuncion Moreno, Jan Odijk, Stelios Piperidis
- Venue:
- LREC
- SIG:
- Publisher:
- European Language Resources Association (ELRA)
- Note:
- Pages:
- 1927–1931
- Language:
- URL:
- http://www.lrec-conf.org/proceedings/lrec2012/pdf/766_Paper.pdf
- DOI:
- Cite (ACL):
- Atro Voutilainen, Kristiina Muhonen, Tanja Purtonen, and Krister Lindén. 2012. Specifying Treebanks, Outsourcing Parsebanks: FinnTreeBank 3. In Proceedings of the Eighth International Conference on Language Resources and Evaluation (LREC'12), pages 1927–1931, Istanbul, Turkey. European Language Resources Association (ELRA).
- Cite (Informal):
- Specifying Treebanks, Outsourcing Parsebanks: FinnTreeBank 3 (Voutilainen et al., LREC 2012)
- PDF:
- http://www.lrec-conf.org/proceedings/lrec2012/pdf/766_Paper.pdf