Cognitive Feedback: Decoding Human Feedback from Cognitive Signals

Yuto Harada, Yohei Oseki


Abstract
Alignment methods such as Direct Preference Optimization (DPO) have played a crucial role in enhancing the performance of large language models. However, conventional approaches typically require creating large amounts of explicit preference labels, which is costly, time-consuming, and demands sustained human attention.In this work, we propose Cognitive Preference Optimization (CPO), a novel alignment method that infers preferences from electroencephalography (EEG) signals recorded while annotators simply read text, eliminating the need for explicit labeling. To our knowledge, this is the first empirical investigation of EEG-based feedback as an alternative to conventional human annotations for aligning language models.Experiments on controlled sentiment generation show that CPO achieves performance comparable to explicit human feedback, suggesting that brain-signal-derived preferences can provide a viable, lower-burden pathway for language model alignment.
Anthology ID:
2025.hcinlp-1.17
Volume:
Proceedings of the Fourth Workshop on Bridging Human-Computer Interaction and Natural Language Processing (HCI+NLP)
Month:
November
Year:
2025
Address:
Suzhou, China
Editors:
Su Lin Blodgett, Amanda Cercas Curry, Sunipa Dev, Siyan Li, Michael Madaio, Jack Wang, Sherry Tongshuang Wu, Ziang Xiao, Diyi Yang
Venues:
HCINLP | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
209–219
Language:
URL:
https://preview.aclanthology.org/ingest-emnlp/2025.hcinlp-1.17/
DOI:
Bibkey:
Cite (ACL):
Yuto Harada and Yohei Oseki. 2025. Cognitive Feedback: Decoding Human Feedback from Cognitive Signals. In Proceedings of the Fourth Workshop on Bridging Human-Computer Interaction and Natural Language Processing (HCI+NLP), pages 209–219, Suzhou, China. Association for Computational Linguistics.
Cite (Informal):
Cognitive Feedback: Decoding Human Feedback from Cognitive Signals (Harada & Oseki, HCINLP 2025)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-emnlp/2025.hcinlp-1.17.pdf