Decoding Reading Goals from Eye Movements

Omer Shubi, Cfir Avraham Hadar, Yevgeni Berzak


Abstract
Readers can have different goals with respect to the text that they are reading. Can these goals be decoded from their eye movements over the text? In this work, we examine for the first time whether it is possible to distinguish between two types of common reading goals: information seeking and ordinary reading for comprehension. Using large-scale eye tracking data, we address this task with a wide range of models that cover different architectural and data representation strategies, and further introduce a new model ensemble. We find that transformer-based models with scanpath representations coupled with language modeling solve it most successfully, and that accurate predictions can be made in real time, shortly after the participant started reading the text. We further introduce a new method for model performance analysis based on mixed effect modeling. Combining this method with rich textual annotations reveals key properties of textual items and participants that contribute to the difficulty of the task, and improves our understanding of the variability in eye movement patterns across the two reading regimes.
Anthology ID:
2025.acl-long.280
Volume:
Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Month:
July
Year:
2025
Address:
Vienna, Austria
Editors:
Wanxiang Che, Joyce Nabende, Ekaterina Shutova, Mohammad Taher Pilehvar
Venue:
ACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
5616–5637
Language:
URL:
https://preview.aclanthology.org/ingestion-acl-25/2025.acl-long.280/
DOI:
Bibkey:
Cite (ACL):
Omer Shubi, Cfir Avraham Hadar, and Yevgeni Berzak. 2025. Decoding Reading Goals from Eye Movements. In Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 5616–5637, Vienna, Austria. Association for Computational Linguistics.
Cite (Informal):
Decoding Reading Goals from Eye Movements (Shubi et al., ACL 2025)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingestion-acl-25/2025.acl-long.280.pdf