Annotating Dimensions of Social Perception in Text: A Sentence-Level Dataset of Warmth and Competence

Mutaz Ayesh, Saif M. Mohammad, Nedjma Ousidhoum


Abstract
*Warmth* (W) (often further broken down into*Trust* (T) and *Sociability* (S)) and *Competence* (C) are central dimensions along which people evaluate individuals and social groups (Fiske, 2018). While these constructs are well established in social psychology, they are only starting to get attention in NLP research through word-level lexicons, which do not fully capture their contextual expression in larger text units and discourse. In this work, we introduce*Warmth and Competence Sentences (W C-Sent)*, the first sentence-level dataset annotated for warmth and competence. The dataset includes over 1,600 English sentence–target pairs annotated along three dimensions: *trust* and *sociability* (components of *warmth*), and *competence*. The sentences in W C-Sent are social media posts that express attitudes and opinions about specific individuals or social groups (the targets of our annotations). We describe the data collection, annotation, and quality-control procedures in detail, and evaluate a range of large language models (LLMs) on their ability to identify trust, sociability, and competence in text. W C-Sent provides a new resource for analyzing warmth and competence in language and supports future research at the intersection of NLP and computational social science.
Anthology ID:
2026.acl-long.289
Volume:
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Month:
July
Year:
2026
Address:
San Diego, California, United States
Editors:
Maria Liakata, Viviane P. Moreira, Jiajun Zhang, David Jurgens
Venue:
ACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
6374–6412
Language:
URL:
https://preview.aclanthology.org/ingest-acl/2026.acl-long.289/
DOI:
Bibkey:
Cite (ACL):
Mutaz Ayesh, Saif M. Mohammad, and Nedjma Ousidhoum. 2026. Annotating Dimensions of Social Perception in Text: A Sentence-Level Dataset of Warmth and Competence. In Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 6374–6412, San Diego, California, United States. Association for Computational Linguistics.
Cite (Informal):
Annotating Dimensions of Social Perception in Text: A Sentence-Level Dataset of Warmth and Competence (Ayesh et al., ACL 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-acl/2026.acl-long.289.pdf
Checklist:
 2026.acl-long.289.checklist.pdf