A Computational Analysis of Vagueness in Revisions of Instructional Texts

Alok Debnath, Michael Roth


Abstract
WikiHow is an open-domain repository of instructional articles for a variety of tasks, which can be revised by users. In this paper, we extract pairwise versions of an instruction before and after a revision was made. Starting from a noisy dataset of revision histories, we specifically extract and analyze edits that involve cases of vagueness in instructions. We further investigate the ability of a neural model to distinguish between two versions of an instruction in our data by adopting a pairwise ranking task from previous work and showing improvements over existing baselines.
Anthology ID:
2021.eacl-srw.5
Volume:
Proceedings of the 16th Conference of the European Chapter of the Association for Computational Linguistics: Student Research Workshop
Month:
April
Year:
2021
Address:
Online
Venue:
EACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
30–35
Language:
URL:
https://aclanthology.org/2021.eacl-srw.5
DOI:
10.18653/v1/2021.eacl-srw.5
Bibkey:
Cite (ACL):
Alok Debnath and Michael Roth. 2021. A Computational Analysis of Vagueness in Revisions of Instructional Texts. In Proceedings of the 16th Conference of the European Chapter of the Association for Computational Linguistics: Student Research Workshop, pages 30–35, Online. Association for Computational Linguistics.
Cite (Informal):
A Computational Analysis of Vagueness in Revisions of Instructional Texts (Debnath & Roth, EACL 2021)
Copy Citation:
PDF:
https://preview.aclanthology.org/update-css-js/2021.eacl-srw.5.pdf
Data
FrameNet