ADEA: An Argumentative Dialogue Dataset on Ethical Issues Concerning Future A.I. Applications

Christian Hauptmann, Adrian Krenzer, Antonia Krause, Frank Puppe

Abstract
Introducing ADEA: a German dataset that captures online dialogues and focuses on ethical issues related to future AI applications. This dataset, which includes over 2800 labeled user utterances on four different topics, is specifically designed for the training of chatbots that can navigate the complexities of real-world ethical AI conversations. The creation of these dialogues is the result of two carefully conducted studies in which university students interacted with an argumentative dialogue system. A fundamental part of our methodology is the use of German argument graphs. These graphs not only form the knowledge base of the dialogue system but also serve as an effective annotation scheme for the dialogues. Apart from the introduction of the dataset and the argument graphs, we provide a preliminary benchmark using GPT-4 via the OpenAI API. This provides researchers with a concrete reference point while demonstrating the potential of our dataset. We make our dataset and argument graphs available at https://github.com/HaupChris/ADEA-Dialogue-Dataset.
Anthology ID:
2024.lrec-main.38
Volume:
Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024)
Month:
May
Year:
2024
Address:
Torino, Italia
Editors:
Nicoletta Calzolari, Min-Yen Kan, Veronique Hoste, Alessandro Lenci, Sakriani Sakti, Nianwen Xue
Venues:
LREC | COLING
SIG:
Publisher:
ELRA and ICCL
Note:
Pages:
426–437
Language:
URL:
https://aclanthology.org/2024.lrec-main.38
DOI:
Bibkey:
Cite (ACL):
Christian Hauptmann, Adrian Krenzer, Antonia Krause, and Frank Puppe. 2024. ADEA: An Argumentative Dialogue Dataset on Ethical Issues Concerning Future A.I. Applications. In Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024), pages 426–437, Torino, Italia. ELRA and ICCL.
Cite (Informal):
ADEA: An Argumentative Dialogue Dataset on Ethical Issues Concerning Future A.I. Applications (Hauptmann et al., LREC-COLING 2024)
Copy Citation:
PDF:
https://preview.aclanthology.org/nschneid-patch-4/2024.lrec-main.38.pdf
PDF Search