Youngwoo Kim


2019

pdf bib
FEVER Breaker’s Run of Team NbAuzDrLqg
Youngwoo Kim | James Allan
Proceedings of the Second Workshop on Fact Extraction and VERification (FEVER)

We describe our submission for the Breaker phase of the second Fact Extraction and VERification (FEVER) Shared Task. Our adversarial data can be explained by two perspectives. First, we aimed at testing model’s ability to retrieve evidence, when appropriate query terms could not be easily generated from the claim. Second, we test model’s ability to precisely understand the implications of the texts, which we expect to be rare in FEVER 1.0 dataset. Overall, we suggested six types of adversarial attacks. The evaluation on the submitted systems showed that the systems were only able get both the evidence and label correct in 20% of the data. We also demonstrate our adversarial run analysis in the data development process.
Search
Co-authors
Venues