Misalignments in Common Ground as a Bridge Between Pragmatic Theory and LLM Evaluation

Judith Sieker, Sina Zarrieß


Abstract
In this position paper, we argue that misalignments in common ground are not marginal failures of communication, but central diagnostic moments for pragmatic competence, and should therefore play a key role in the evaluation of Large Language Models (LLMs). Evaluating how models respond to such instances of mismatched or incomplete understanding moves beyond surface fluency and correctness, targeting pragmatic competence at a deeper, interactional level. At the same time, misalignments provide controlled settings for testing linguistic theories of common ground, repair, or accommodation – areas that are often difficult to investigate in human communication. We argue that this dual role makes misalignments a natural bridge between pragmatic theory and LLM evaluation.
Anthology ID:
2026.brigap-1.8
Volume:
Proceedings of the Third Workshop on the Bridges and Gaps between Formal and Computational Linguistics (BriGap-3)
Month:
July
Year:
2026
Address:
Paris, France
Editors:
Timothée Bernard, Emmanuele Chersoni, Giulia Rambelli
Venues:
BriGap | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
74–81
Language:
URL:
https://preview.aclanthology.org/ingest-brigap/2026.brigap-1.8/
DOI:
Bibkey:
Cite (ACL):
Judith Sieker and Sina Zarrieß. 2026. Misalignments in Common Ground as a Bridge Between Pragmatic Theory and LLM Evaluation. In Proceedings of the Third Workshop on the Bridges and Gaps between Formal and Computational Linguistics (BriGap-3), pages 74–81, Paris, France. Association for Computational Linguistics.
Cite (Informal):
Misalignments in Common Ground as a Bridge Between Pragmatic Theory and LLM Evaluation (Sieker & Zarrieß, BriGap 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-brigap/2026.brigap-1.8.pdf