Elvis vs. M. Jackson: Who has More Albums? Classification and Identification of Elements in Comparative Questions

Meriem Beloucif, Seid Muhie Yimam, Steffen Stahlhacke, Chris Biemann

Abstract
Comparative Question Answering (cQA) is the task of providing concrete and accurate responses to queries such as: “Is Lyft cheaper than a regular taxi?” or “What makes a mortgage different from a regular loan?”. In this paper, we propose two new open-domain real-world datasets for identifying and labeling comparative questions. While the first dataset contains instances of English questions labeled as comparative vs. non-comparative, the second dataset provides additional labels including the objects and the aspects of comparison. We conduct several experiments that evaluate the soundness of our datasets. The evaluation of our datasets using various classifiers show promising results that reach close-to-human results on a binary classification task with a neural model using ALBERT embeddings. When approaching the unsupervised sequence labeling task, some headroom remains.
Anthology ID:
2022.lrec-1.402
Volume:
Proceedings of the Thirteenth Language Resources and Evaluation Conference
Month:
June
Year:
2022
Address:
Marseille, France
Venue:
LREC
SIG:
Publisher:
European Language Resources Association
Note:
Pages:
3771–3779
Language:
URL:
https://aclanthology.org/2022.lrec-1.402
DOI:
Bibkey:
Cite (ACL):
Meriem Beloucif, Seid Muhie Yimam, Steffen Stahlhacke, and Chris Biemann. 2022. Elvis vs. M. Jackson: Who has More Albums? Classification and Identification of Elements in Comparative Questions. In Proceedings of the Thirteenth Language Resources and Evaluation Conference, pages 3771–3779, Marseille, France. European Language Resources Association.
Cite (Informal):
Elvis vs. M. Jackson: Who has More Albums? Classification and Identification of Elements in Comparative Questions (Beloucif et al., LREC 2022)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingestion-script-update/2022.lrec-1.402.pdf
PDF Search