Averroes at BEA 2025 Shared Task: Verifying Mistake Identification in Tutor, Student Dialogue

Mazen Yasser, Mariam Saeed, Hossam Elkordi, Ayman Khalafallah


Abstract
This paper presents the approach and findings of Averroes Team in the BEA 2025 Shared Task Track 1: Mistake Identification. Our system uses the multilingual understanding capabilities of general text embedding models. Our approach involves full-model fine-tuning, where both the pre-trained language model and the classification head are optimized to detect tutor recognition of student mistakes in educational dialogues. This end-to-end training enables the model to better capture subtle pedagogical cues, leading to improved contextual understanding. Evaluated on the official test set, our system achieved an exact macro-F_1 score of 0.7155 and an accuracy of 0.8675, securing third place among the participating teams. These results underline the effectiveness of task-specific optimization in enhancing model sensitivity to error recognition within interactive learning contexts.
Anthology ID:
2025.bea-1.87
Volume:
Proceedings of the 20th Workshop on Innovative Use of NLP for Building Educational Applications (BEA 2025)
Month:
July
Year:
2025
Address:
Vienna, Austria
Editors:
Ekaterina Kochmar, Bashar Alhafni, Marie Bexte, Jill Burstein, Andrea Horbach, Ronja Laarmann-Quante, Anaïs Tack, Victoria Yaneva, Zheng Yuan
Venues:
BEA | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
1121–1126
Language:
URL:
https://preview.aclanthology.org/acl25-workshop-ingestion/2025.bea-1.87/
DOI:
Bibkey:
Cite (ACL):
Mazen Yasser, Mariam Saeed, Hossam Elkordi, and Ayman Khalafallah. 2025. Averroes at BEA 2025 Shared Task: Verifying Mistake Identification in Tutor, Student Dialogue. In Proceedings of the 20th Workshop on Innovative Use of NLP for Building Educational Applications (BEA 2025), pages 1121–1126, Vienna, Austria. Association for Computational Linguistics.
Cite (Informal):
Averroes at BEA 2025 Shared Task: Verifying Mistake Identification in Tutor, Student Dialogue (Yasser et al., BEA 2025)
Copy Citation:
PDF:
https://preview.aclanthology.org/acl25-workshop-ingestion/2025.bea-1.87.pdf