Small Language Models for Less-Resourced Languages in a Real-World Scenario: The Case for Catalan
Roser Saurí, Josep Sànchez-Ferreres, Lluis Padro, Josep Carmona
Abstract
Small Language Models (SLMs), typically ranging from a few million to 10–15 billion parameters, offer a promising solution towards constraints imposed by platform size–particularly mobile and IoT devices–and by the requirements of many organizations such as SMEs, which need solutions that ensure data privacy while remaining cost-effective. Their compactness and efficiency provide digital sovereignty and flexibility, though with more limited general-purpose capabilities. This makes them especially sensitive when working with underrepresented languages, such as Catalan, due to interference from majority languages that can increase bias risk. This paper evaluates state-of-the-art SLMs in a real-world Catalan use case: an AI assistant for older adults, assessing both user interactions and structured function call generation. Our work, which contributes to the Anonymized-Project initiative for deploying a connected SLM-based infrastructure under the Model Context Protocol, demonstrates that some SLMs are able to deliver high-quality performance even in resource-constrained, linguistically minority environments.- Anthology ID:
- 2026.sigul-1.27
- Volume:
- Proceedings of the SIGUL 2026 Joint Workshop with ELE, EURALI, and DCLRL: Towards Inclusivity and Equality: Language Resources and Technologies for Under-Resourced and Endangered Languages
- Month:
- May
- Year:
- 2026
- Address:
- Palma, Mallorca, Spain
- Editors:
- Atul Kr. Ojha, Sakriani Sakti, Claudia Soria, Maite Melero, John P. McCrae, Constantine Lignos, Chao-Hong Liu, German Rigau Claramunt, Georg Rehm
- Venues:
- SIGUL | EURALI | DCLRL | WS
- SIG:
- Publisher:
- ELRA Language Resources Association (ELRA)
- Note:
- Pages:
- 270–279
- Language:
- External URL:
- https://lrec.elra.info/lrec2026-ws-sigul-27
- DOI:
- 10.63317/4qn4qiyiwuze
- Cite (ACL):
- Roser Saurí, Josep Sànchez-Ferreres, Lluis Padro, and Josep Carmona. 2026. Small Language Models for Less-Resourced Languages in a Real-World Scenario: The Case for Catalan. In Proceedings of the SIGUL 2026 Joint Workshop with ELE, EURALI, and DCLRL: Towards Inclusivity and Equality: Language Resources and Technologies for Under-Resourced and Endangered Languages, pages 270–279, Palma, Mallorca, Spain. ELRA Language Resources Association (ELRA).
- Cite (Informal):
- Small Language Models for Less-Resourced Languages in a Real-World Scenario: The Case for Catalan (Saurí et al., SIGUL-EURALI-DCLRL 2026)