Do large language models and humans follow similar learning stages? Assessing GPT-2’s order of Swedish grammar acquisition within the Processability Theory framework

Stella Lundqvist, Murathan Kurfali, Johan Sjons


Abstract
We investigate whether GPT-2 acquires Swedish grammatical structures in the same implicational order as for human second language (L2) learners, as predicted by Processability Theory (PT). We present SwePT – a minimal pair dataset targeting Swedish syntactic and morphological structures that are acquired by human L2 learners on four separate stages of language development – and evaluate the GPT-2 models on SwePT using an acceptability classification task throughout fine-tuning with different input orders in regards to the grammatical structures identified in the data. We find that the observed acquisition orders correlate across the fine-tuned models, while violating the implicational order sequence as hypothesized by PT. The observed relation between performance on the classification task and frequency distributions of the contrasting features in the minimal pairs suggests that the acquisition order can be explained by unigram and n-gram heuristics. While the adaptation of NLP methodologies into the PT framework requires further conceptual and methodological refinement, we do not find evidence for PT-like grammatical development in our experiments.
Anthology ID:
2026.cdl-1.10
Volume:
Proceedings of the 1st Workshop on Computational Developmental Linguistics (CDL)
Month:
July
Year:
2026
Address:
Grand Hyatt Manchester San Diego, 1 Market Pl, San Diego, CA 92101
Editors:
Martin Ziqiao Ma, Emmy Liu, Jing Liu, Tyler A. Chang, Abdellah Fourtassi, Alex Warstadt, Michael Hahn, Weiwei Sun, Freda Shi
Venues:
CDL | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
52–76
Language:
URL:
https://preview.aclanthology.org/ingest-acl-workshops/2026.cdl-1.10/
DOI:
Bibkey:
Cite (ACL):
Stella Lundqvist, Murathan Kurfali, and Johan Sjons. 2026. Do large language models and humans follow similar learning stages? Assessing GPT-2’s order of Swedish grammar acquisition within the Processability Theory framework. In Proceedings of the 1st Workshop on Computational Developmental Linguistics (CDL), pages 52–76, Grand Hyatt Manchester San Diego, 1 Market Pl, San Diego, CA 92101. Association for Computational Linguistics.
Cite (Informal):
Do large language models and humans follow similar learning stages? Assessing GPT-2’s order of Swedish grammar acquisition within the Processability Theory framework (Lundqvist et al., CDL 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-acl-workshops/2026.cdl-1.10.pdf