From Dataset Recycling to Multi-Property Extraction and Beyond
Tomasz Dwojak, Michał Pietruszka, Łukasz Borchmann, Jakub Chłędowski, Filip Graliński
Abstract
This paper investigates various Transformer architectures on the WikiReading Information Extraction and Machine Reading Comprehension dataset. The proposed dual-source model outperforms the current state-of-the-art by a large margin. Next, we introduce WikiReading Recycled - a newly developed public dataset, and the task of multiple-property extraction. It uses the same data as WikiReading but does not inherit its predecessor’s identified disadvantages. In addition, we provide a human-annotated test set with diagnostic subsets for a detailed analysis of model performance.- Anthology ID:
- 2020.conll-1.52
- Volume:
- Proceedings of the 24th Conference on Computational Natural Language Learning
- Month:
- November
- Year:
- 2020
- Address:
- Online
- Editors:
- Raquel Fernández, Tal Linzen
- Venue:
- CoNLL
- SIG:
- SIGNLL
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 641–651
- Language:
- URL:
- https://aclanthology.org/2020.conll-1.52
- DOI:
- 10.18653/v1/2020.conll-1.52
- Cite (ACL):
- Tomasz Dwojak, Michał Pietruszka, Łukasz Borchmann, Jakub Chłędowski, and Filip Graliński. 2020. From Dataset Recycling to Multi-Property Extraction and Beyond. In Proceedings of the 24th Conference on Computational Natural Language Learning, pages 641–651, Online. Association for Computational Linguistics.
- Cite (Informal):
- From Dataset Recycling to Multi-Property Extraction and Beyond (Dwojak et al., CoNLL 2020)
- PDF:
- https://preview.aclanthology.org/nschneid-patch-3/2020.conll-1.52.pdf
- Code
- applicaai/multi-property-extraction
- Data
- WikiReading Recycled, GLUE, SNLI, SQuAD, WikiReading