Creating POS Tagging and Dependency Parsing Experts via Topic Modeling

Atreyee Mukherjee, Sandra Kübler, Matthias Scheutz


Abstract
Part of speech (POS) taggers and dependency parsers tend to work well on homogeneous datasets but their performance suffers on datasets containing data from different genres. In our current work, we investigate how to create POS tagging and dependency parsing experts for heterogeneous data by employing topic modeling. We create topic models (using Latent Dirichlet Allocation) to determine genres from a heterogeneous dataset and then train an expert for each of the genres. Our results show that the topic modeling experts reach substantial improvements when compared to the general versions. For dependency parsing, the improvement reaches 2 percent points over the full training baseline when we use two topics.
Anthology ID:
E17-1033
Volume:
Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics: Volume 1, Long Papers
Month:
April
Year:
2017
Address:
Valencia, Spain
Venue:
EACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
347–355
Language:
URL:
https://aclanthology.org/E17-1033
DOI:
Bibkey:
Cite (ACL):
Atreyee Mukherjee, Sandra Kübler, and Matthias Scheutz. 2017. Creating POS Tagging and Dependency Parsing Experts via Topic Modeling. In Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics: Volume 1, Long Papers, pages 347–355, Valencia, Spain. Association for Computational Linguistics.
Cite (Informal):
Creating POS Tagging and Dependency Parsing Experts via Topic Modeling (Mukherjee et al., EACL 2017)
Copy Citation:
PDF:
https://preview.aclanthology.org/paclic-22-ingestion/E17-1033.pdf