Eytan Adar
2026
Beyond Screenshots: Evaluating VLMs’ Understanding of UI Animations
Chen Liang | Xirui Jiang | Naihao Deng | Eytan Adar | Anhong Guo
Findings of the Association for Computational Linguistics: ACL 2026
Chen Liang | Xirui Jiang | Naihao Deng | Eytan Adar | Anhong Guo
Findings of the Association for Computational Linguistics: ACL 2026
AI agents operating on user interfaces must understand how interfaces communicate state and feedback to act reliably. As a core communicative modality, animations are increasingly used in modern interfaces, serving critical functional purposes beyond mere aesthetics. Thus, understanding UI animation is essential for comprehensive interface interpretation. However, recent studies of Vision Language Models (VLMs) for UI understanding have focused primarily on static screenshots, leaving it unclear how well these models handle dynamic UI animations. To address this gap, we created AniMINT, a novel dataset of 300 densely annotated UI animation videos.We systematically evaluate state-of-the-art VLMs on UI animation understanding, including their abilities to perceive the animation effects, identify animation purposes, and interpret animation meaning. Our results show that VLMs can reliably detect primitive motion.However, their high-level animation interpretation remains inconsistent, with substantial gaps relative to human performance. Finally, we use Motion, Context, and Perceptual Cues (MCPC) to probe factors affecting VLM performance, revealing key bottlenecks and directions for future improvement.
2017
Learning Word Relatedness over Time
Guy D. Rosin | Eytan Adar | Kira Radinsky
Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing
Guy D. Rosin | Eytan Adar | Kira Radinsky
Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing
Search systems are often focused on providing relevant results for the “now”, assuming both corpora and user needs that focus on the present. However, many corpora today reflect significant longitudinal collections ranging from 20 years of the Web to hundreds of years of digitized newspapers and books. Understanding the temporal intent of the user and retrieving the most relevant historical content has become a significant challenge. Common search features, such as query expansion, leverage the relationship between terms but cannot function well across all times when relationships vary temporally. In this work, we introduce a temporal relationship model that is extracted from longitudinal data collections. The model supports the task of identifying, given two words, when they relate to each other. We present an algorithmic framework for this task and show its application for the task of query expansion, achieving high gain.
2016
SimpleScience: Lexical Simplification of Scientific Terminology
Yea-Seul Kim | Jessica Hullman | Matthew Burgess | Eytan Adar
Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing
Yea-Seul Kim | Jessica Hullman | Matthew Burgess | Eytan Adar
Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing
Prototype Synthesis for Model Laws
Matthew Burgess | Eugenia Giraudy | Eytan Adar
Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Matthew Burgess | Eugenia Giraudy | Eytan Adar
Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)