I2C Huelva at SemEval-2023 Task 4: A Resampling and Transformers Approach to Identify Human Values behind Arguments
Nordin El Balima Cordero, Jacinto Mata Vázquez, Victoria Pachón Álvarez, Abel Pichardo Estevez
Abstract
This paper presents the approaches proposedfor I2C Group to address the SemEval-2023Task 4: Identification of Human Values behindArguments (ValueEval)”, whose goal is to classify 20 different categories of human valuesgiven a textual argument. The dataset of thistask consists of one argument per line, including its unique argument ID, conclusion, stanceof the premise towards the conclusion and thepremise text. To indicate whether the argumentdraws or not on that category a binary indication (1 or 0) is included. Participants can submit approaches that detect one, multiple, or allof these values in arguments. The task providesan opportunity for researchers to explore theuse of automated techniques to identify humanvalues in text and has potential applications invarious domains such as social science, politics,and marketing. To deal with the imbalancedclass distribution given, our approach undersamples the data. Additionally, the three components of the argument (conclusion, stanceand premise) are used for training. The systemoutperformed the BERT baseline according toofficial evaluation metrics, achieving a f1 scoreof 0.46.- Anthology ID:
- 2023.semeval-1.191
- Volume:
- Proceedings of the 17th International Workshop on Semantic Evaluation (SemEval-2023)
- Month:
- July
- Year:
- 2023
- Address:
- Toronto, Canada
- Editors:
- Atul Kr. Ojha, A. Seza Doğruöz, Giovanni Da San Martino, Harish Tayyar Madabushi, Ritesh Kumar, Elisa Sartori
- Venue:
- SemEval
- SIG:
- SIGLEX
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 1382–1387
- Language:
- URL:
- https://aclanthology.org/2023.semeval-1.191
- DOI:
- 10.18653/v1/2023.semeval-1.191
- Cite (ACL):
- Nordin El Balima Cordero, Jacinto Mata Vázquez, Victoria Pachón Álvarez, and Abel Pichardo Estevez. 2023. I2C Huelva at SemEval-2023 Task 4: A Resampling and Transformers Approach to Identify Human Values behind Arguments. In Proceedings of the 17th International Workshop on Semantic Evaluation (SemEval-2023), pages 1382–1387, Toronto, Canada. Association for Computational Linguistics.
- Cite (Informal):
- I2C Huelva at SemEval-2023 Task 4: A Resampling and Transformers Approach to Identify Human Values behind Arguments (El Balima Cordero et al., SemEval 2023)
- PDF:
- https://preview.aclanthology.org/nschneid-patch-3/2023.semeval-1.191.pdf