RABIT: Rationale-Based Distillation Towards Interpretable Automatic Speaking Assessment via a Small Language Model
Bi-Cheng Yan, Hong-Yun Lin, Fu-An Chao, Jiun-Ting Li, Berlin Chen
Abstract
Automatic speaking assessment (ASA) manages to quantify the language competence of foreign language learners by providing a proficiency score based on their spoken response. Existing efforts in ASA typically employ a neural grader integrated with a set of handcrafted features to assess learners’ oral proficiency from multiple facets. Despite decent performance, the black-box nature of these neural graders remains a significant barrier to providing interpretable explanations for the grading results. In light of this, we propose RABIT for ASA, a novel Rationale-based knowledge distillation framework for interpretable grading decisions via a small language model. Specifically, RABIT first extracts multi-faceted grading rationales from a large language model (LLM) pertaining to the learner’s response and the scoring guidelines. Subsequently, a compact yet efficient language model, equipped with distinct output heads, is jointly optimized to estimate a proficiency score while generating a sequence of grading rationales in an autoregressive manner. A series of experiments conducted on General English Proficiency Test (GEPT) dataset validates the feasibility and superiority of our method over several cutting-edge baselines.- Anthology ID:
- 2026.bea-1.9
- Volume:
- Proceedings of the 21st Workshop on Innovative Use of NLP for Building Educational Applications (BEA 2026)
- Month:
- July
- Year:
- 2026
- Address:
- San Diego, California, USA
- Editors:
- Ekaterina Kochmar, Bashar Alhafni, Stefano Bannò, Marie Bexte, Jill Burstein, Andrea Horbach, Ronja Laarmann-Quante, Anais Tack, Victoria Yaneva, Zheng Yuan
- Venues:
- BEA | WS
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 108–117
- Language:
- URL:
- https://preview.aclanthology.org/ingest-acl-workshops/2026.bea-1.9/
- DOI:
- Cite (ACL):
- Bi-Cheng Yan, Hong-Yun Lin, Fu-An Chao, Jiun-Ting Li, and Berlin Chen. 2026. RABIT: Rationale-Based Distillation Towards Interpretable Automatic Speaking Assessment via a Small Language Model. In Proceedings of the 21st Workshop on Innovative Use of NLP for Building Educational Applications (BEA 2026), pages 108–117, San Diego, California, USA. Association for Computational Linguistics.
- Cite (Informal):
- RABIT: Rationale-Based Distillation Towards Interpretable Automatic Speaking Assessment via a Small Language Model (Yan et al., BEA 2026)
- PDF:
- https://preview.aclanthology.org/ingest-acl-workshops/2026.bea-1.9.pdf