@inproceedings{sood-etal-2025-scanez,
    title = "{S}can{EZ}: Integrating Cognitive Models with Self-Supervised Learning for Spatiotemporal Scanpath Prediction",
    author = "Sood, Ekta  and
      Dhar, Prajit  and
      Troiano, Enrica  and
      Southwell, Rosy  and
      D{'}Mello, Sidney K.",
    editor = "Che, Wanxiang  and
      Nabende, Joyce  and
      Shutova, Ekaterina  and
      Pilehvar, Mohammad Taher",
    booktitle = "Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers)",
    month = jul,
    year = "2025",
    address = "Vienna, Austria",
    publisher = "Association for Computational Linguistics",
    url = "https://preview.aclanthology.org/corrections-2025-10/2025.acl-short.89/",
    doi = "10.18653/v1/2025.acl-short.89",
    pages = "1132--1142",
    ISBN = "979-8-89176-252-7",
    abstract = "Accurately predicting human scanpaths during reading is vital for diverse fields and downstream tasks, from educational technologies to automatic question answering. To date, however, progress in this direction remains limited by scarce gaze data. We overcome the issue with ScanEZ, a self-supervised framework grounded in cognitive models of reading. ScanEZ jointly models the spatial and temporal dimensions of scanpaths by leveraging synthetic data and a 3-D gaze objective inspired by masked language modeling. With this framework, we provide evidence that two key factors in scanpath prediction during reading are: the use of masked modeling of both spatial and temporal patterns of eye movements, and cognitive model simulations as an inductive bias to kick-start training. Our approach achieves state-of-the-art results on established datasets (e.g., up to 31.4{\%} negative log-likelihood improvement on CELER L1), and proves portable across different experimental conditions."
}