Abstract
HCI and NLP traditionally focus on different evaluation methods. While HCI involves a small number of people directly and deeply, NLP traditionally relies on standardized benchmark evaluations that involve a larger number of people indirectly. We present five methodological proposals at the intersection of HCI and NLP and situate them in the context of ML-based NLP models. Our goal is to foster interdisciplinary collaboration and progress in both fields by emphasizing what the fields can learn from each other.- Anthology ID:
- 2021.hcinlp-1.5
- Volume:
- Proceedings of the First Workshop on Bridging Human–Computer Interaction and Natural Language Processing
- Month:
- April
- Year:
- 2021
- Address:
- Online
- Editors:
- Su Lin Blodgett, Michael Madaio, Brendan O'Connor, Hanna Wallach, Qian Yang
- Venue:
- HCINLP
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 28–33
- Language:
- URL:
- https://aclanthology.org/2021.hcinlp-1.5
- DOI:
- Cite (ACL):
- Hendrik Heuer and Daniel Buschek. 2021. Methods for the Design and Evaluation of HCI+NLP Systems. In Proceedings of the First Workshop on Bridging Human–Computer Interaction and Natural Language Processing, pages 28–33, Online. Association for Computational Linguistics.
- Cite (Informal):
- Methods for the Design and Evaluation of HCI+NLP Systems (Heuer & Buschek, HCINLP 2021)
- PDF:
- https://preview.aclanthology.org/emnlp-22-attachments/2021.hcinlp-1.5.pdf