Overview of the 2020 WOSP 3C Citation Context Classification Task
Suchetha Nambanoor Kunnath, David Pride, Bikash Gyawali, Petr Knoth
Abstract
The 3C Citation Context Classification task is the first shared task addressing citation context classification. The two subtasks, A and B, associated with this shared task, involves the classification of citations based on their purpose and influence, respectively. Both tasks use a portion of the new ACT dataset, developed by the researchers at The Open University, UK. The tasks were hosted on Kaggle, and the participated systems were evaluated using the macro f-score. Three teams participated in subtask A and four teams participated in subtask B. The best performing systems obtained an overall score of 0.2056 for subtask A and 0.5556 for subtask B, outperforming the simple majority class baseline models, which scored 0.11489 and 0.32249, respectively. In this paper we provide a report specifying the shared task, the dataset used, a short description of the participating systems and the final results obtained by the teams based on the evaluation criteria. The shared task has been organised as part of the 8th International Workshop on Mining Scientific Publications (WOSP 2020) workshop.- Anthology ID:
- 2020.wosp-1.12
- Volume:
- Proceedings of the 8th International Workshop on Mining Scientific Publications
- Month:
- 05 August
- Year:
- 2020
- Address:
- Wuhan, China
- Venue:
- WOSP
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 75–83
- Language:
- URL:
- https://aclanthology.org/2020.wosp-1.12
- DOI:
- Cite (ACL):
- Suchetha Nambanoor Kunnath, David Pride, Bikash Gyawali, and Petr Knoth. 2020. Overview of the 2020 WOSP 3C Citation Context Classification Task. In Proceedings of the 8th International Workshop on Mining Scientific Publications, pages 75–83, Wuhan, China. Association for Computational Linguistics.
- Cite (Informal):
- Overview of the 2020 WOSP 3C Citation Context Classification Task (Kunnath et al., WOSP 2020)
- PDF:
- https://preview.aclanthology.org/remove-xml-comments/2020.wosp-1.12.pdf
- Data
- SciCite