Ontology-Style Relation Annotation: A Case Study

Savong Bou, Naoki Suzuki, Makoto Miwa, Yutaka Sasaki

Abstract
This paper proposes an Ontology-Style Relation (OSR) annotation approach. In conventional Relation Extraction (RE) datasets, relations are annotated as links between entity mentions. In contrast, in our OSR annotation, a relation is annotated as a relation mention (i.e., not a link but a node) and domain and range links are annotated from the relation mention to its argument entity mentions. We expect the following benefits: (1) the relation annotations can be easily converted to Resource Description Framework (RDF) triples to populate an Ontology, (2) some part of conventional RE tasks can be tackled as Named Entity Recognition (NER) tasks. The relation classes are limited to several RDF properties such as domain, range, and subClassOf, and (3) OSR annotations can be clear documentations of Ontology contents. As a case study, we converted an in-house corpus of Japanese traffic rules in conventional annotations into the OSR annotations and built a novel OSR-RoR (Rules of the Road) corpus. The inter-annotator agreements of the conversion were 85-87%. We evaluated the performance of neural NER and RE tools on the conventional and OSR annotations. The experimental results showed that the OSR annotations make the RE task easier while introducing slight complexity into the NER task.
Anthology ID:
2020.lrec-1.599
Volume:
Proceedings of the Twelfth Language Resources and Evaluation Conference
Month:
May
Year:
2020
Address:
Marseille, France
Editors:
Nicoletta Calzolari, Frédéric Béchet, Philippe Blache, Khalid Choukri, Christopher Cieri, Thierry Declerck, Sara Goggi, Hitoshi Isahara, Bente Maegaard, Joseph Mariani, Hélène Mazo, Asuncion Moreno, Jan Odijk, Stelios Piperidis
Venue:
LREC
SIG:
Publisher:
European Language Resources Association
Note:
Pages:
4867–4876
Language:
English
URL:
https://aclanthology.org/2020.lrec-1.599
DOI:
Bibkey:
Cite (ACL):
Savong Bou, Naoki Suzuki, Makoto Miwa, and Yutaka Sasaki. 2020. Ontology-Style Relation Annotation: A Case Study. In Proceedings of the Twelfth Language Resources and Evaluation Conference, pages 4867–4876, Marseille, France. European Language Resources Association.
Cite (Informal):
Ontology-Style Relation Annotation: A Case Study (Bou et al., LREC 2020)
Copy Citation:
PDF:
https://preview.aclanthology.org/dois-2013-emnlp/2020.lrec-1.599.pdf
PDF Search