SubmissionNumber#=%=#46
FinalPaperTitle#=%=#DeBERTa at SemEval-2024 Task 9: Using DeBERTa for Defying Common Sense
ShortPaperTitle#=%=#
NumberOfPages#=%=#7
CopyrightSigned#=%=#Marco Siino
JobTitle#==#
Organization#==#University of Catania
Abstract#==#The widespread success of language models has spurred the natural language processing (NLP) community to tackle tasks demanding implicit and intricate reasoning, drawing upon human-like common-sense mechanisms. While endeavors in vertical thinking tasks have garnered considerable attention, there has been a relative dearth of exploration in lateral thinking puzzles. To address this gap, we introduce BRAINTEASER: a multiple-choice Question Answering task meticulously crafted to evaluate the model's capacity for lateral thinking and its ability to challenge default common-sense associations. At the SemEval-2024 Task 9, for the first subtask (i.e., Sentence Puzzle) the organizers asked the participants to develop models able to reply to multi-answer brain-teasing questions. For this purpose, we propose the application of a DeBERTa model in a zero-shot configuration. Our proposed approach is able to reach an overall score of 0.250. Suggesting a significant room for improvements in future works.
Author{1}{Firstname}#=%=#Marco
Author{1}{Lastname}#=%=#Siino
Author{1}{Username}#=%=#marcosiino
Author{1}{Email}#=%=#marco.siino@unipa.it
Author{1}{Affiliation}#=%=#Università degli Studi di Catania

==========
èéáğö