Colleen Robb
2025
Using LLMs to identify features of personal and professional skills in an open-response situational judgment test
Cole Walsh | Rodica Ivan | Muhammad Zafar Iqbal | Colleen Robb
Proceedings of the Artificial Intelligence in Measurement and Education Conference (AIME-Con): Full Papers
Cole Walsh | Rodica Ivan | Muhammad Zafar Iqbal | Colleen Robb
Proceedings of the Artificial Intelligence in Measurement and Education Conference (AIME-Con): Full Papers
Current methods for assessing personal and professional skills lack scalability due to reliance on human raters, while NLP-based systems for assessing these skills fail to demonstrate construct validity. This study introduces a new method utilizing LLMs to extract construct-relevant features from responses to an assessment of personal and professional skills.