Reproducing a Comparison of Hedged and Non-hedged NLG Texts

Saad Mahamood


Abstract
This paper describes an attempt to reproduce an earlier experiment, previously conducted by the author, that compares hedged and non-hedged NLG texts as part of the ReproGen shared challenge. This reproduction effort was only able to partially replicate results from the original study. The analyisis from this reproduction effort suggests that whilst it is possible to replicate the procedural aspects of a previous study, replicating the results can prove more challenging as differences in participant type can have a potential impact.
Anthology ID:
2021.inlg-1.29
Volume:
Proceedings of the 14th International Conference on Natural Language Generation
Month:
August
Year:
2021
Address:
Aberdeen, Scotland, UK
Editors:
Anya Belz, Angela Fan, Ehud Reiter, Yaji Sripada
Venue:
INLG
SIG:
SIGGEN
Publisher:
Association for Computational Linguistics
Note:
Pages:
282–285
Language:
URL:
https://aclanthology.org/2021.inlg-1.29
DOI:
10.18653/v1/2021.inlg-1.29
Bibkey:
Cite (ACL):
Saad Mahamood. 2021. Reproducing a Comparison of Hedged and Non-hedged NLG Texts. In Proceedings of the 14th International Conference on Natural Language Generation, pages 282–285, Aberdeen, Scotland, UK. Association for Computational Linguistics.
Cite (Informal):
Reproducing a Comparison of Hedged and Non-hedged NLG Texts (Mahamood, INLG 2021)
Copy Citation:
PDF:
https://preview.aclanthology.org/nschneid-patch-2/2021.inlg-1.29.pdf
Code
 saad-mahamood/reprohum2021