SubmissionNumber#=%=#18
FinalPaperTitle#=%=#NLPDame at ClimateActivism 2024: Mistral Sequence Classification with PEFT for Hate Speech, Targets and Stance Event Detection
ShortPaperTitle#=%=#
NumberOfPages#=%=#
CopyrightSigned#=%=#
JobTitle#==#
Organization#==#
Abstract#==#The paper presents the approach developed for the "Climate Activism Stance and Hate Event Detection" Shared Task at CASE 2024, comprising three sub-tasks. The Shared Task aimed to create a system capable of detecting hate speech, identifying the targets of hate speech, and determining the stance regarding climate change activism events in English tweets. The approach involved data cleaning and pre-processing, addressing data imbalance, and fine-tuning the "mistralai/Mistral-7B-v0.1" LLM for sequence classification using PEFT (Parameter-Efficient Fine-Tuning). The LLM was fine-tuned using two PEFT methods, namely LoRA and prompt tuning, for each sub-task, resulting in the development of six Mistral-7B fine-tuned models in total. Although both methods surpassed the baseline model scores of the task organizers, the prompt tuning method yielded the highest results. Specifically, the prompt tuning method achieved a Macro-F1 score of 0.8649, 0.6106 and 0.6930 in the test data of sub-tasks A, B and C, respectively.
Author{1}{Firstname}#=%=#Christina
Author{1}{Lastname}#=%=#Christodoulou
Author{1}{Username}#=%=#christiechris
Author{1}{Email}#=%=#christinachristodoulou1997@gmail.com
Author{1}{Affiliation}#=%=#Institute of Informatics & Telecommunications, National Centre for Scientific Research, "Demokritos"

==========
èéáğö