Do Language Models Show Structural Priming Across Different Domains?

So Young Lee, Russell Scheinberg, Ameeta Agrawal


Abstract
We test whether large language models show cross-domain structural priming by asking whether arithmetic expressions influence relative-clause attachment preferences. Experiment 1 examines English and French using materials based on prior psycholinguistic studies, and Experiment 2 extends the test to a larger multilingual dataset. Across both experiments, we find no robust priming effect. Instead, responses largely reflect baseline attachment preferences, which vary across languages and only partially align with human patterns. These findings suggest that, although language models show some structural sensitivity, they provide limited evidence of abstract structural generalization across domains.
Anthology ID:
2026.cdl-1.9
Volume:
Proceedings of the 1st Workshop on Computational Developmental Linguistics (CDL)
Month:
July
Year:
2026
Address:
Grand Hyatt Manchester San Diego, 1 Market Pl, San Diego, CA 92101
Editors:
Martin Ziqiao Ma, Emmy Liu, Jing Liu, Tyler A. Chang, Abdellah Fourtassi, Alex Warstadt, Michael Hahn, Weiwei Sun, Freda Shi
Venues:
CDL | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
37–51
Language:
URL:
https://preview.aclanthology.org/ingest-acl-workshops/2026.cdl-1.9/
DOI:
Bibkey:
Cite (ACL):
So Young Lee, Russell Scheinberg, and Ameeta Agrawal. 2026. Do Language Models Show Structural Priming Across Different Domains?. In Proceedings of the 1st Workshop on Computational Developmental Linguistics (CDL), pages 37–51, Grand Hyatt Manchester San Diego, 1 Market Pl, San Diego, CA 92101. Association for Computational Linguistics.
Cite (Informal):
Do Language Models Show Structural Priming Across Different Domains? (Lee et al., CDL 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-acl-workshops/2026.cdl-1.9.pdf