SubmissionNumber#=%=#78
FinalPaperTitle#=%=#JN666 at SemEval-2024 Task 7: NumEval: Numeral-Aware Language Understanding and Generation
ShortPaperTitle#=%=#
NumberOfPages#=%=#6
CopyrightSigned#=%=#Xinyi Liu, Xintong Liu and Hengyang Lu
JobTitle#==#
Organization#==#School of Artificial Intelligence and Computer Science, Jiangnan University, Wuxi, China
Abstract#==#This paper is submitted for SemEval-2027 task 7: Enhancing the Model's Understanding and Generation of Numerical Values. The dataset for this task is NQuAD, which requires us to select the most suitable option number from four numerical options to fill in the blank in a news article based on the context. Based on the BertForMultipleChoice model, we proposed two new models, MC BERT and SSC BERT, and improved the model's numerical understanding ability by pre-training the model on numerical comparison tasks. Ultimately, our best-performing model achieved an accuracy rate of 79.40%, which is 9.45% higher than the accuracy rate of NEMo.
Author{1}{Firstname}#=%=#Xinyi
Author{1}{Lastname}#=%=#Liu
Author{1}{Username}#=%=#lxy0316
Author{1}{Email}#=%=#1130174701@qq.com
Author{1}{Affiliation}#=%=#JiangNan University
Author{2}{Firstname}#=%=#Xintong
Author{2}{Lastname}#=%=#Liu
Author{2}{Email}#=%=#liuxintong@stu.jiangnan.edu.cn
Author{2}{Affiliation}#=%=#JiangNan University
Author{3}{Firstname}#=%=#Hengyang
Author{3}{Lastname}#=%=#Lu
Author{3}{Email}#=%=#luhengyang@jiangnan.edu.cn
Author{3}{Affiliation}#=%=#JiangNan University

==========
èéáğö