Developmentally-plausible Working Memory Shapes a Critical Period for Language Acquisition

Masato Mita, Ryo Yoshida, Yohei Oseki


Abstract
Large language models possess general linguistic abilities but acquire language less efficiently than humans. This study proposes a method for integrating the developmental characteristics of working memory during the critical period, a stage when human language acquisition is particularly efficient, into the training process of language models. The proposed method introduces a mechanism that initially constrains working memory during the early stages of training and gradually relaxes this constraint in an exponential manner as learning progresses. Targeted syntactic evaluation shows that the proposed method outperforms conventional methods without memory constraints or with static memory constraints. These findings not only provide new directions for designing data-efficient language models but also offer indirect evidence supporting the role of the developmental characteristics of working memory as the underlying mechanism of the critical period in language acquisition.
Anthology ID:
2025.acl-long.462
Volume:
Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Month:
July
Year:
2025
Address:
Vienna, Austria
Editors:
Wanxiang Che, Joyce Nabende, Ekaterina Shutova, Mohammad Taher Pilehvar
Venue:
ACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
9386–9399
Language:
URL:
https://preview.aclanthology.org/ingestion-acl-25/2025.acl-long.462/
DOI:
Bibkey:
Cite (ACL):
Masato Mita, Ryo Yoshida, and Yohei Oseki. 2025. Developmentally-plausible Working Memory Shapes a Critical Period for Language Acquisition. In Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 9386–9399, Vienna, Austria. Association for Computational Linguistics.
Cite (Informal):
Developmentally-plausible Working Memory Shapes a Critical Period for Language Acquisition (Mita et al., ACL 2025)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingestion-acl-25/2025.acl-long.462.pdf