SubmissionNumber#=%=#25
FinalPaperTitle#=%=#Mistral at SemEval-2024 Task 5: Mistral 7B for argument reasoning in Civil Procedure
ShortPaperTitle#=%=#
NumberOfPages#=%=#8
CopyrightSigned#=%=#Marco Siino
JobTitle#==#
Organization#==#University of Catania
Abstract#==#At the SemEval-2024 Task 5, the organizers introduce a novel natural language processing (NLP) challenge and dataset within the realm of the United States civil procedure. Each datum within the dataset comprises a comprehensive overview of a legal case, a specific inquiry associated with it, and a potential argument in support of a solution, supplemented with an in-depth rationale elucidating the applicability of the argument within the given context. Derived from a text designed for legal education purposes, this dataset presents a multifaceted benchmarking task for contemporary legal language models. Our manuscript delineates the approach we adopted for participation in this competition. Specifically, we detail the use of a Mistral 7B model to answer the question provided. Our only and best submission reach an F1-score equal to 0.5597 and an Accuracy of 0.5714, outperforming the baseline provided for the task.
Author{1}{Firstname}#=%=#Marco
Author{1}{Lastname}#=%=#Siino
Author{1}{Username}#=%=#marcosiino
Author{1}{Email}#=%=#marco.siino@unipa.it
Author{1}{Affiliation}#=%=#Università degli Studi di Catania

==========
èéáğö