Exploring the Integration of Eye Movement Data on Word Embeddings
Fermín Travi, Gabriel Aimé Leclercq, Diego Fernandez Slezak, Bruno Bianchi, Juan E Kamienkowski
Abstract
Reading, while structured, is a non-linear process. Readers may skip some words, linger on others, or revisit earlier text. Emerging work has started exploring the incorporation of reading behaviour through eye-tracking into the training of specific language tasks. In this work, we investigate the broader question of how gaze data can shape word embeddings by using text as read by human participants and predicting gaze measures from them. To that end, we conducted an eye-tracking experiment with 76 participants reading 20 short stories in Spanish and fine-tuned Word2Vec and LSTM models on the collected data. Evaluations with representational similarity analysis and word pair similarities showed a limited, but largely consistent, gain from gaze incorporation, suggesting future work should expand linguistic diversity and use cognitively aligned evaluations to better understand its role in bridging computational and human language representations.- Anthology ID:
- 2025.cmcl-1.9
- Volume:
- Proceedings of the Workshop on Cognitive Modeling and Computational Linguistics
- Month:
- May
- Year:
- 2025
- Address:
- Albuquerque, New Mexico, USA
- Editors:
- Tatsuki Kuribayashi, Giulia Rambelli, Ece Takmaz, Philipp Wicke, Jixing Li, Byung-Doh Oh
- Venues:
- CMCL | WS
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 55–65
- Language:
- URL:
- https://preview.aclanthology.org/fix-sig-urls/2025.cmcl-1.9/
- DOI:
- Cite (ACL):
- Fermín Travi, Gabriel Aimé Leclercq, Diego Fernandez Slezak, Bruno Bianchi, and Juan E Kamienkowski. 2025. Exploring the Integration of Eye Movement Data on Word Embeddings. In Proceedings of the Workshop on Cognitive Modeling and Computational Linguistics, pages 55–65, Albuquerque, New Mexico, USA. Association for Computational Linguistics.
- Cite (Informal):
- Exploring the Integration of Eye Movement Data on Word Embeddings (Travi et al., CMCL 2025)
- PDF:
- https://preview.aclanthology.org/fix-sig-urls/2025.cmcl-1.9.pdf