Angel Ortmann Lee
2025
When Machines Mislead: Human Review of Erroneous AI Cheating Signals
William Belzak
|
Chenhao Niu
|
Angel Ortmann Lee
Proceedings of the Artificial Intelligence in Measurement and Education Conference (AIME-Con): Works in Progress
This study examines how human proctors interpret AI-generated alerts for misconduct in remote assessments. Findings suggest proctors can identify false positives, though confirmation bias and differences across test-taker nationalities were observed. Results highlight opportunities to refine proctoring guidelines and strengthen fairness in human oversight of automated signals in high-stakes testing.
Keystroke Analysis in Digital Test Security: AI Approaches for Copy-Typing Detection and Cheating Ring Identification
Chenhao Niu
|
Yong-Siang Shih
|
Manqian Liao
|
Ruidong Liu
|
Angel Ortmann Lee
Proceedings of the Artificial Intelligence in Measurement and Education Conference (AIME-Con): Works in Progress
This project leverages AI-based analysis of keystroke and mouse data to detect copy-typing and identify cheating rings in the Duolingo English Test. By modeling behavioral biometrics, the approach provides actionable signals to proctors, enhancing digital test security for large-scale online assessment.