Abstract
This research explores the feasibility of applying the cognitive diagnosis assessment (CDA) framework to validate generative AI-based scoring of constructed responses (CRs). The classification information of CRs and item-parameter estimates from cognitive diagnosis models (CDMs) could provide additional validity evidence for AI-generated CR scores and feedback.- Anthology ID:
- 2025.aimecon-wip.20
- Volume:
- Proceedings of the Artificial Intelligence in Measurement and Education Conference (AIME-Con): Works in Progress
- Month:
- October
- Year:
- 2025
- Address:
- Wyndham Grand Pittsburgh, Downtown, Pittsburgh, Pennsylvania, United States
- Editors:
- Joshua Wilson, Christopher Ormerod, Magdalen Beiting Parrish
- Venue:
- AIME-Con
- SIG:
- Publisher:
- National Council on Measurement in Education (NCME)
- Note:
- Pages:
- 166–177
- Language:
- URL:
- https://preview.aclanthology.org/ingest-naloma/2025.aimecon-wip.20/
- DOI:
- Cite (ACL):
- Hyunjoo Kim. 2025. Validating Generative AI Scoring of Constructed Responses with Cognitive Diagnosis. In Proceedings of the Artificial Intelligence in Measurement and Education Conference (AIME-Con): Works in Progress, pages 166–177, Wyndham Grand Pittsburgh, Downtown, Pittsburgh, Pennsylvania, United States. National Council on Measurement in Education (NCME).
- Cite (Informal):
- Validating Generative AI Scoring of Constructed Responses with Cognitive Diagnosis (Kim, AIME-Con 2025)
- PDF:
- https://preview.aclanthology.org/ingest-naloma/2025.aimecon-wip.20.pdf