Ferryman as SemEval-2020 Task 5: Optimized BERT for Detecting Counterfactuals
Weilong Chen, Yan Zhuang, Peng Wang, Feng Hong, Yan Wang, Yanru Zhang
Abstract
The main purpose of this article is to state the effect of using different methods and models for counterfactual determination and detection of causal knowledge. Nowadays, counterfactual reasoning has been widely used in various fields. In the realm of natural language process(NLP), counterfactual reasoning has huge potential to improve the correctness of a sentence. In the shared Task 5 of detecting counterfactual in SemEval 2020, we pre-process the officially given dataset according to case conversion, extract stem and abbreviation replacement. We use last-5 bidirectional encoder representation from bidirectional encoder representation from transformer (BERT)and term frequency–inverse document frequency (TF-IDF) vectorizer for counterfactual detection. Meanwhile, multi-sample dropout and cross validation are used to improve versatility and prevent problems such as poor generosity caused by overfitting. Finally, our team Ferryman ranked the 8th place in the sub-task 1 of this competition.- Anthology ID:
- 2020.semeval-1.84
- Volume:
- Proceedings of the Fourteenth Workshop on Semantic Evaluation
- Month:
- December
- Year:
- 2020
- Address:
- Barcelona (online)
- Editors:
- Aurelie Herbelot, Xiaodan Zhu, Alexis Palmer, Nathan Schneider, Jonathan May, Ekaterina Shutova
- Venue:
- SemEval
- SIG:
- SIGLEX
- Publisher:
- International Committee for Computational Linguistics
- Note:
- Pages:
- 653–657
- Language:
- URL:
- https://aclanthology.org/2020.semeval-1.84
- DOI:
- 10.18653/v1/2020.semeval-1.84
- Cite (ACL):
- Weilong Chen, Yan Zhuang, Peng Wang, Feng Hong, Yan Wang, and Yanru Zhang. 2020. Ferryman as SemEval-2020 Task 5: Optimized BERT for Detecting Counterfactuals. In Proceedings of the Fourteenth Workshop on Semantic Evaluation, pages 653–657, Barcelona (online). International Committee for Computational Linguistics.
- Cite (Informal):
- Ferryman as SemEval-2020 Task 5: Optimized BERT for Detecting Counterfactuals (Chen et al., SemEval 2020)
- PDF:
- https://preview.aclanthology.org/nschneid-patch-4/2020.semeval-1.84.pdf