Cross-linguistic Geometry of Adjective Representations in Multilingual Transformers: Semantic Class, Gradability, and Positional Effects.

Tancredi Monterosso


Abstract
In this study, we examine whether multilingual contextual embeddings encode properties of adjectives that are theoretically relevant to formal analyses of nominal modification. Using Universal Dependencies corpora for Arabic, English, and Italian, we extract contextualized adjective embeddings from the multilingual XLM-RoBERTa model and analyze them with respect to (i) semantic classes, (ii) the distinction between relational and descriptive adjectives, (iii) the distinction between gradable and non-gradable adjectives, and (iv) prenominal versus postnominal position in Italian. Our results indicate that adjective representations are organized in a shared multilingual space, but that this space is not best accounted for by a rigidly aligned universal hierarchy of semantic classes. Rather, the most salient organizing dimensions correspond to broader semantic-syntactic contrasts, in particular the relational/descriptive opposition, gradability, and, in the case of Italian, position-conditioned variation.
Anthology ID:
2026.brigap-1.3
Volume:
Proceedings of the Third Workshop on the Bridges and Gaps between Formal and Computational Linguistics (BriGap-3)
Month:
July
Year:
2026
Address:
Paris, France
Editors:
Timothée Bernard, Emmanuele Chersoni, Giulia Rambelli
Venues:
BriGap | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
22–30
Language:
URL:
https://preview.aclanthology.org/ingest-brigap/2026.brigap-1.3/
DOI:
Bibkey:
Cite (ACL):
Tancredi Monterosso. 2026. Cross-linguistic Geometry of Adjective Representations in Multilingual Transformers: Semantic Class, Gradability, and Positional Effects.. In Proceedings of the Third Workshop on the Bridges and Gaps between Formal and Computational Linguistics (BriGap-3), pages 22–30, Paris, France. Association for Computational Linguistics.
Cite (Informal):
Cross-linguistic Geometry of Adjective Representations in Multilingual Transformers: Semantic Class, Gradability, and Positional Effects. (Monterosso, BriGap 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-brigap/2026.brigap-1.3.pdf