@inproceedings{gold-etal-2019-annotating,
    title = "Annotating and analyzing the interactions between meaning relations",
    author = "Gold, Darina  and
      Kovatchev, Venelin  and
      Zesch, Torsten",
    editor = "Friedrich, Annemarie  and
      Zeyrek, Deniz  and
      Hoek, Jet",
    booktitle = "Proceedings of the 13th Linguistic Annotation Workshop",
    month = aug,
    year = "2019",
    address = "Florence, Italy",
    publisher = "Association for Computational Linguistics",
    url = "https://preview.aclanthology.org/iwcs-25-ingestion/W19-4004/",
    doi = "10.18653/v1/W19-4004",
    pages = "26--36",
    abstract = "Pairs of sentences, phrases, or other text pieces can hold semantic relations such as paraphrasing, textual entailment, contradiction, specificity, and semantic similarity. These relations are usually studied in isolation and no dataset exists where they can be compared empirically. Here we present a corpus annotated with these relations and the analysis of these results. The corpus contains 520 sentence pairs, annotated with these relations. We measure the annotation reliability of each individual relation and we examine their interactions and correlations. Among the unexpected results revealed by our analysis is that the traditionally considered direct relationship between paraphrasing and bi-directional entailment does not hold in our data."
}