Xiang Fu
2025
BLCU-ICALL at BEA 2025 Shared Task: Multi-Strategy Evaluation of AI Tutors
Jiyuan An
|
Xiang Fu
|
Bo Liu
|
Xuquan Zong
|
Cunliang Kong
|
Shuliang Liu
|
Shuo Wang
|
Zhenghao Liu
|
Liner Yang
|
Hanghang Fan
|
Erhong Yang
Proceedings of the 20th Workshop on Innovative Use of NLP for Building Educational Applications (BEA 2025)
This paper describes our approaches for the BEA-2025 Shared Task on assessing pedagogical ability and attributing tutor identities in AI-powered tutoring systems. We explored three methodological paradigms: in-context learning (ICL), supervised fine-tuning (SFT), and reinforcement learning from human feedback (RLHF). Results indicate clear methodological strengths: SFT is highly effective for structured classification tasks such as mistake identification and feedback actionability, while ICL with advanced prompting excels at open-ended tasks involving mistake localization and instructional guidance. Additionally, fine-tuned models demonstrated strong performance in identifying tutor authorship. Our findings highlight the importance of aligning methodological strategy and task structure, providing insights toward more effective evaluations of educational AI systems.
Search
Fix author
Co-authors
- Jiyuan An 1
- Hanghang Fan 1
- Cunliang Kong (孔存良) 1
- Bo Liu 1
- Shuliang Liu 1
- show all...