@inproceedings{yuan-yu-2018-evaluation,
    title = "An Evaluation of Information Extraction Tools for Identifying Health Claims in News Headlines",
    author = "Yuan, Shi  and
      Yu, Bei",
    editor = "Caselli, Tommaso  and
      Miller, Ben  and
      van Erp, Marieke  and
      Vossen, Piek  and
      Palmer, Martha  and
      Hovy, Eduard  and
      Mitamura, Teruko  and
      Caswell, David  and
      Brown, Susan W.  and
      Bonial, Claire",
    booktitle = "Proceedings of the Workshop Events and Stories in the News 2018",
    month = aug,
    year = "2018",
    address = "Santa Fe, New Mexico, U.S.A",
    publisher = "Association for Computational Linguistics",
    url = "https://preview.aclanthology.org/iwcs-25-ingestion/W18-4305/",
    pages = "34--43",
    abstract = "This study evaluates the performance of four information extraction tools (extractors) on identifying health claims in health news headlines. A health claim is defined as a triplet: IV (what is being manipulated), DV (what is being measured) and their relation. Tools that can identify health claims provide the foundation for evaluating the accuracy of these claims against authoritative resources. The evaluation result shows that 26{\%} headlines do not in-clude health claims, and all extractors face difficulty separating them from the rest. For those with health claims, OPENIE-5.0 performed the best with F-measure at 0.6 level for ex-tracting ``IV-relation-DV''. However, the characteristic linguistic structures in health news headlines, such as incomplete sentences and non-verb relations, pose particular challenge to existing tools."
}