Visual Question Answering and the relation between language, perception and the world

Staffan Larsson, Bill Noble, Robin Cooper


Abstract
We outline a general account of VQA using a perception-oriented formal semantic framework. We believe that it is instructive to describe VQA not only in terms of an engineering challenge, but also as a linguistically and philosophically relevant task that can help us better understand the relation between language, perception and the world. Specifically, we will argue that linguistic meaning helps us structure our takes on visual scenes, enabling us to classify situations so that we e.g. can answer questions and determine whether a sentence correctly describes a scene.
Anthology ID:
2026.naloma-1.8
Volume:
Proceedings of the 6th Workshop on Natural Language Meets Logic and Machine Learning (NALOMA)
Month:
August
Year:
2026
Address:
Prague, Czechia
Editors:
Hitomi Yanaka, Lasha Abzianidze
Venues:
NALOMA | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
60–70
Language:
URL:
https://preview.aclanthology.org/ingest-naloma/2026.naloma-1.8/
DOI:
Bibkey:
Cite (ACL):
Staffan Larsson, Bill Noble, and Robin Cooper. 2026. Visual Question Answering and the relation between language, perception and the world. In Proceedings of the 6th Workshop on Natural Language Meets Logic and Machine Learning (NALOMA), pages 60–70, Prague, Czechia. Association for Computational Linguistics.
Cite (Informal):
Visual Question Answering and the relation between language, perception and the world (Larsson et al., NALOMA 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-naloma/2026.naloma-1.8.pdf