Danielle R Thomas

Fixing paper assignments

  1. Please select all papers that belong to the same person.
  2. Indicate below which author they should be assigned to.
Provide a valid ORCID iD here. This will be used to match future papers to this author.
Provide the name of the school or the university where the author has received or will receive their highest degree (e.g., Ph.D. institution for researchers, or current affiliation for students). This will be used to form the new author page ID, if needed.

TODO: "submit" and "cancel" buttons here

2025

pdf bib
Beyond Agreement: Rethinking Ground Truth in Educational AI Annotation
Danielle R Thomas | Conrad Borchers | Ken Koedinger
Proceedings of the Artificial Intelligence in Measurement and Education Conference (AIME-Con): Full Papers

Humans are biased, inconsistent, and yet we keep trusting them to define “ground truth.” This paper questions the overreliance on inter-rater reliability in educational AI and proposes a multidimensional approach leveraging expert-based approaches and close-the-loop validity to build annotations that reflect impact, not just agreement. It’s time we do better.
Search
Co-authors
Venues
Fix data