@inproceedings{jansen-ustalov-2019-textgraphs,
    title = "{T}ext{G}raphs 2019 Shared Task on Multi-Hop Inference for Explanation Regeneration",
    author = "Jansen, Peter  and
      Ustalov, Dmitry",
    editor = "Ustalov, Dmitry  and
      Somasundaran, Swapna  and
      Jansen, Peter  and
      Glava{\v{s}}, Goran  and
      Riedl, Martin  and
      Surdeanu, Mihai  and
      Vazirgiannis, Michalis",
    booktitle = "Proceedings of the Thirteenth Workshop on Graph-Based Methods for Natural Language Processing (TextGraphs-13)",
    month = nov,
    year = "2019",
    address = "Hong Kong",
    publisher = "Association for Computational Linguistics",
    url = "https://preview.aclanthology.org/jlcl-multiple-ingestion/D19-5309/",
    doi = "10.18653/v1/D19-5309",
    pages = "63--77",
    abstract = "While automated question answering systems are increasingly able to retrieve answers to natural language questions, their ability to generate detailed human-readable explanations for their answers is still quite limited. The Shared Task on Multi-Hop Inference for Explanation Regeneration tasks participants with regenerating detailed gold explanations for standardized elementary science exam questions by selecting facts from a knowledge base of semi-structured tables. Each explanation contains between 1 and 16 interconnected facts that form an {\textquotedblleft}explanation graph{\textquotedblright} spanning core scientific knowledge and detailed world knowledge. It is expected that successfully combining these facts to generate detailed explanations will require advancing methods in multi-hop inference and information combination, and will make use of the supervised training data provided by the WorldTree explanation corpus. The top-performing system achieved a mean average precision (MAP) of 0.56, substantially advancing the state-of-the-art over a baseline information retrieval model. Detailed extended analyses of all submitted systems showed large relative improvements in accessing the most challenging multi-hop inference problems, while absolute performance remains low, highlighting the difficulty of generating detailed explanations through multi-hop reasoning."
}