Will Gen Z users look for evidence to verify QA System-generated answers?

Souma Gayen, Dina Demner-Fushman, Deepak Gupta


Abstract
The remarkable results shown by medicalquestion-answering systems lead to theiradoption in real-life applications. The systems,however, may misinform the users, even whendrawing on scientific evidence to ground theresults. The quality of the answers maybe verified by the users if they analyze theevidence provided by the systems. Userinterfaces play an important role in engagingthe users. While studies of the user interfacesfor biomedical literature search and clinicaldecision support are abundant, little is knownabout users’ interactions with medical questionanswering systems and the impact of thesesystems on health-related decisions. In a studyof several different user interface layouts, wefound that only a small number of participantsfollowed the links to verify automaticallygenerated answers, independently of theinterface design. The users who followed thelinks made better health-related decisions.
Anthology ID:
2025.cl4health-1.19
Volume:
Proceedings of the Second Workshop on Patient-Oriented Language Processing (CL4Health)
Month:
May
Year:
2025
Address:
Albuquerque, New Mexico
Editors:
Sophia Ananiadou, Dina Demner-Fushman, Deepak Gupta, Paul Thompson
Venues:
CL4Health | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
228–235
Language:
URL:
https://preview.aclanthology.org/fix-sig-urls/2025.cl4health-1.19/
DOI:
Bibkey:
Cite (ACL):
Souma Gayen, Dina Demner-Fushman, and Deepak Gupta. 2025. Will Gen Z users look for evidence to verify QA System-generated answers?. In Proceedings of the Second Workshop on Patient-Oriented Language Processing (CL4Health), pages 228–235, Albuquerque, New Mexico. Association for Computational Linguistics.
Cite (Informal):
Will Gen Z users look for evidence to verify QA System-generated answers? (Gayen et al., CL4Health 2025)
Copy Citation:
PDF:
https://preview.aclanthology.org/fix-sig-urls/2025.cl4health-1.19.pdf