Po-Ya Angela Wang
2026
Using Perspectival Words Is Harder Than Vocabulary Words for Humans —and Even More So for Multimodal Language Models
Dota Tianai Dong | Yifan Luo | Po-Ya Angela Wang | Asli Ozyurek | Paula Rubio-Fernandez
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Dota Tianai Dong | Yifan Luo | Po-Ya Angela Wang | Asli Ozyurek | Paula Rubio-Fernandez
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Multimodal language models (MLMs) increasingly demonstrate human-like communication, yet their use of everyday perspectival words remains poorly understood. To address this gap, we compare humans and MLMs in their use of three word types, which we predict impose increasing cognitive demands: vocabulary (e.g., ’boat’ or ’cup’), possessives (e.g., ’mine’ vs. ’yours’), and demonstratives (e.g., ’this one’ vs. ’that one’). Testing seven MLMs against human participants, we find that perspectival words are harder than vocabulary words for both groups. The gap is even larger for MLMs: while models approach human-level performance on using vocabulary, they exhibit clear deficits with possessives and even greater difficulties with demonstratives. Ablation analyses point to limitations in perspective-taking and spatial reasoning as key sources of these gaps in MLMs. Instruction-based prompting helps close the gap for possessives but still leaves demonstratives far below human performance. These results show that, unlike vocabulary, perspectival words pose a greater challenge in human communication—and this difficulty is further amplified in MLMs, revealing a crucial shortfall in their pragmatic and social-cognitive abilities.
2023
Exploring Affordance and Situated Meaning in Image Captions: A Multimodal Analysis
Pin-Er Chen | Po-Ya Angela Wang | Hsin-Yu Chou | Yu-Hsiang Tseng | Shu-Kai Hsieh
Proceedings of the 37th Pacific Asia Conference on Language, Information and Computation
Pin-Er Chen | Po-Ya Angela Wang | Hsin-Yu Chou | Yu-Hsiang Tseng | Shu-Kai Hsieh
Proceedings of the 37th Pacific Asia Conference on Language, Information and Computation
Lexical Retrieval Hypothesis in Multimodal Context
Po-Ya Angela Wang | Pin-Er Chen | Hsin-Yu Chou | Yu-Hsiang Tseng | Shu-Kai Hsieh
Proceedings of the 4th Conference on Language, Data and Knowledge
Po-Ya Angela Wang | Pin-Er Chen | Hsin-Yu Chou | Yu-Hsiang Tseng | Shu-Kai Hsieh
Proceedings of the 4th Conference on Language, Data and Knowledge
2021
Keyword-centered Collocating Topic Analysis
Yu-Lin Chang | Yongfu Liao | Po-Ya Angela Wang | Mao-Chang Ku | Shu-Kai Hsieh
Proceedings of the 33rd Conference on Computational Linguistics and Speech Processing (ROCLING 2021)
Yu-Lin Chang | Yongfu Liao | Po-Ya Angela Wang | Mao-Chang Ku | Shu-Kai Hsieh
Proceedings of the 33rd Conference on Computational Linguistics and Speech Processing (ROCLING 2021)
The rapid flow of information and the abundance of text data on the Internet have brought about the urgent demand for the construction of monitoring resources and techniques used for various purposes. To extract facets of information useful for particular domains from such large and dynamically growing corpora requires an unsupervised yet transparent ways of analyzing the textual data. This paper proposed a hybrid collocation analysis as a potential method to retrieve and summarize Taiwan-related topics posted on Weibo and PTT. By grouping collocates of 臺灣 ‘Taiwan’ into clusters of topics via either word embeddings clustering or Latent Dirichlet allocation, lists of collocates can be converted to probability distributions such that distances and similarities can be defined and computed. With this method, we conduct a diachronic analysis of the similarity between Weibo and PTT, providing a way to pinpoint when and how the topic similarity between the two rises or falls. A fine-grained view on the grammatical behavior and political implications is attempted, too. This study thus sheds light on alternative explainable routes for future social media listening method on the understanding of cross-strait relationship.
Examine persuasion strategies in Chinese on social media
Yu-Yun Chang | Po-Ya Angela Wang | Han-Tang Hung | Ka-Sîng Khóo | Shu-Kai Hsieh
Proceedings of the 35th Pacific Asia Conference on Language, Information and Computation
Yu-Yun Chang | Po-Ya Angela Wang | Han-Tang Hung | Ka-Sîng Khóo | Shu-Kai Hsieh
Proceedings of the 35th Pacific Asia Conference on Language, Information and Computation