Pre-trained Language Models’ Interpretation of Evaluativity Implicature: Evidence from Gradable Adjectives Usage in Context

Yan Cong


Abstract
By saying Maria is tall, a human speaker typically implies that Maria is evaluatively tall from the speaker’s perspective. However, by using a different construction Maria is taller than Sophie, we cannot infer from Maria and Sophie’s relative heights that Maria is evaluatively tall because it is possible for Maria to be taller than Sophie in a context in which they both count as short. Can pre-trained language models (LMs) “understand” evaulativity (EVAL) inference? To what extent can they discern the EVAL salience of different constructions in a conversation? Will it help LMs’ implicitness performance if we give LMs a persona such as chill, social, and pragmatically skilled? Our study provides an approach to probing LMs’ interpretation of EVAL inference by incorporating insights from experimental pragmatics and sociolinguistics. We find that with the appropriate prompt, LMs can succeed in some pragmatic level language understanding tasks. Our study suggests that socio-pragmatics methodology can shed light on the challenging questions in NLP.
Anthology ID:
2022.unimplicit-1.1
Volume:
Proceedings of the Second Workshop on Understanding Implicit and Underspecified Language
Month:
July
Year:
2022
Address:
Seattle, USA
Editors:
Valentina Pyatkin, Daniel Fried, Talita Anthonio
Venue:
unimplicit
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
1–7
Language:
URL:
https://aclanthology.org/2022.unimplicit-1.1
DOI:
10.18653/v1/2022.unimplicit-1.1
Bibkey:
Cite (ACL):
Yan Cong. 2022. Pre-trained Language Models’ Interpretation of Evaluativity Implicature: Evidence from Gradable Adjectives Usage in Context. In Proceedings of the Second Workshop on Understanding Implicit and Underspecified Language, pages 1–7, Seattle, USA. Association for Computational Linguistics.
Cite (Informal):
Pre-trained Language Models’ Interpretation of Evaluativity Implicature: Evidence from Gradable Adjectives Usage in Context (Cong, unimplicit 2022)
Copy Citation:
PDF:
https://preview.aclanthology.org/naacl24-info/2022.unimplicit-1.1.pdf
Video:
 https://preview.aclanthology.org/naacl24-info/2022.unimplicit-1.1.mp4