@inproceedings{ben-rim-okazaki-2020-swagex,
    title = "{SWAG}ex at {S}em{E}val-2020 Task 4: Commonsense Explanation as Next Event Prediction",
    author = "Ben Rim, Wiem  and
      Okazaki, Naoaki",
    editor = "Herbelot, Aurelie  and
      Zhu, Xiaodan  and
      Palmer, Alexis  and
      Schneider, Nathan  and
      May, Jonathan  and
      Shutova, Ekaterina",
    booktitle = "Proceedings of the Fourteenth Workshop on Semantic Evaluation",
    month = dec,
    year = "2020",
    address = "Barcelona (online)",
    publisher = "International Committee for Computational Linguistics",
    url = "https://preview.aclanthology.org/ingest-emnlp/2020.semeval-1.51/",
    doi = "10.18653/v1/2020.semeval-1.51",
    pages = "422--429",
    abstract = "We describe the system submitted by the SWAGex team to the SemEval-2020 Commonsense Validation and Explanation Task. We use multiple methods on the pre-trained language model BERT (Devlin et al., 2018) for tasks that require the system to recognize sentences against commonsense and justify the reasoning behind this decision. Our best performing model is BERT trained on SWAG and fine-tuned for the task. We investigate the ability to transfer commonsense knowledge from SWAG to SemEval-2020 by training a model for the Explanation task with Next Event Prediction data"
}