Towards Making a Dependency Parser See

Michalina Strzyz, David Vilares, Carlos Gómez-Rodríguez


Abstract
We explore whether it is possible to leverage eye-tracking data in an RNN dependency parser (for English) when such information is only available during training - i.e. no aggregated or token-level gaze features are used at inference time. To do so, we train a multitask learning model that parses sentences as sequence labeling and leverages gaze features as auxiliary tasks. Our method also learns to train from disjoint datasets, i.e. it can be used to test whether already collected gaze features are useful to improve the performance on new non-gazed annotated treebanks. Accuracy gains are modest but positive, showing the feasibility of the approach. It can serve as a first step towards architectures that can better leverage eye-tracking data or other complementary information available only for training sentences, possibly leading to improvements in syntactic parsing.
Anthology ID:
D19-1160
Volume:
Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP)
Month:
November
Year:
2019
Address:
Hong Kong, China
Editors:
Kentaro Inui, Jing Jiang, Vincent Ng, Xiaojun Wan
Venues:
EMNLP | IJCNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
1500–1506
Language:
URL:
https://aclanthology.org/D19-1160
DOI:
10.18653/v1/D19-1160
Bibkey:
Cite (ACL):
Michalina Strzyz, David Vilares, and Carlos Gómez-Rodríguez. 2019. Towards Making a Dependency Parser See. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), pages 1500–1506, Hong Kong, China. Association for Computational Linguistics.
Cite (Informal):
Towards Making a Dependency Parser See (Strzyz et al., EMNLP-IJCNLP 2019)
Copy Citation:
PDF:
https://preview.aclanthology.org/emnlp22-frontmatter/D19-1160.pdf
Attachment:
 D19-1160.Attachment.pdf
Code
 mstrise/dep2label-eye-tracking-data