@inproceedings{shirai-etal-2019-annotating,
    title = "Annotating with Pros and Cons of Technologies in Computer Science Papers",
    author = "Shirai, Hono  and
      Inoue, Naoya  and
      Suzuki, Jun  and
      Inui, Kentaro",
    editor = "Nastase, Vivi  and
      Roth, Benjamin  and
      Dietz, Laura  and
      McCallum, Andrew",
    booktitle = "Proceedings of the Workshop on Extracting Structured Knowledge from Scientific Publications",
    month = jun,
    year = "2019",
    address = "Minneapolis, Minnesota",
    publisher = "Association for Computational Linguistics",
    url = "https://preview.aclanthology.org/iwcs-25-ingestion/W19-2605/",
    doi = "10.18653/v1/W19-2605",
    pages = "37--42",
    abstract = "This paper explores a task for extracting a technological expression and its pros/cons from computer science papers. We report ongoing efforts on an annotated corpus of pros/cons and an analysis of the nature of the automatic extraction task. Specifically, we show how to adapt the targeted sentiment analysis task for pros/cons extraction in computer science papers and conduct an annotation study. In order to identify the challenges of the automatic extraction task, we construct a strong baseline model and conduct an error analysis. The experiments show that pros/cons can be consistently annotated by several annotators, and that the task is challenging due to domain-specific knowledge. The annotated dataset is made publicly available for research purposes."
}