Abstract
This paper reports on the results of the shared tasks of the COIN workshop at EMNLP-IJCNLP 2019. The tasks consisted of two machine comprehension evaluations, each of which tested a system’s ability to answer questions/queries about a text. Both evaluations were designed such that systems need to exploit commonsense knowledge, for example, in the form of inferences over information that is available in the common ground but not necessarily mentioned in the text. A total of five participating teams submitted systems for the shared tasks, with the best submitted system achieving 90.6% accuracy and 83.7% F1-score on task 1 and task 2, respectively.- Anthology ID:
- D19-6007
- Volume:
- Proceedings of the First Workshop on Commonsense Inference in Natural Language Processing
- Month:
- November
- Year:
- 2019
- Address:
- Hong Kong, China
- Editors:
- Simon Ostermann, Sheng Zhang, Michael Roth, Peter Clark
- Venue:
- WS
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 66–74
- Language:
- URL:
- https://aclanthology.org/D19-6007
- DOI:
- 10.18653/v1/D19-6007
- Cite (ACL):
- Simon Ostermann, Sheng Zhang, Michael Roth, and Peter Clark. 2019. Commonsense Inference in Natural Language Processing (COIN) - Shared Task Report. In Proceedings of the First Workshop on Commonsense Inference in Natural Language Processing, pages 66–74, Hong Kong, China. Association for Computational Linguistics.
- Cite (Informal):
- Commonsense Inference in Natural Language Processing (COIN) - Shared Task Report (Ostermann et al., 2019)
- PDF:
- https://preview.aclanthology.org/nschneid-patch-1/D19-6007.pdf