Nowruz at SemEval-2022 Task 7: Tackling Cloze Tests with Transformers and Ordinal Regression

Mohammadmahdi Nouriborji, Omid Rohanian, David Clifton

Abstract
This paper outlines the system using which team Nowruz participated in SemEval 2022 Task 7 “Identifying Plausible Clarifications of Implicit and Underspecified Phrases” for both subtasks A and B. Using a pre-trained transformer as a backbone, the model targeted the task of multi-task classification and ranking in the context of finding the best fillers for a cloze task related to instructional texts on the website Wikihow. The system employed a combination of two ordinal regression components to tackle this task in a multi-task learning scenario. According to the official leaderboard of the shared task, this system was ranked 5th in the ranking and 7th in the classification subtasks out of 21 participating teams. With additional experiments, the models have since been further optimised. The code used in the experiments is going to be publicly available.
Anthology ID:
2022.semeval-1.151
Volume:
Proceedings of the 16th International Workshop on Semantic Evaluation (SemEval-2022)
Month:
July
Year:
2022
Address:
Seattle, United States
Editors:
Guy Emerson, Natalie Schluter, Gabriel Stanovsky, Ritesh Kumar, Alexis Palmer, Nathan Schneider, Siddharth Singh, Shyam Ratan
Venue:
SemEval
SIG:
SIGLEX
Publisher:
Association for Computational Linguistics
Note:
Pages:
1071–1077
Language:
URL:
https://aclanthology.org/2022.semeval-1.151
DOI:
10.18653/v1/2022.semeval-1.151
Bibkey:
Cite (ACL):
Mohammadmahdi Nouriborji, Omid Rohanian, and David Clifton. 2022. Nowruz at SemEval-2022 Task 7: Tackling Cloze Tests with Transformers and Ordinal Regression. In Proceedings of the 16th International Workshop on Semantic Evaluation (SemEval-2022), pages 1071–1077, Seattle, United States. Association for Computational Linguistics.
Cite (Informal):
Nowruz at SemEval-2022 Task 7: Tackling Cloze Tests with Transformers and Ordinal Regression (Nouriborji et al., SemEval 2022)
Copy Citation:
PDF:
https://preview.aclanthology.org/add_acl24_videos/2022.semeval-1.151.pdf
Code
 mohammadmahdinoori/nowruz-at-semeval-2022-task-7
PDF Search Code