TermEval 2020: Shared Task on Automatic Term Extraction Using the Annotated Corpora for Term Extraction Research (ACTER) Dataset

Ayla Rigouts Terryn, Veronique Hoste, Patrick Drouin, Els Lefever

Abstract
The TermEval 2020 shared task provided a platform for researchers to work on automatic term extraction (ATE) with the same dataset: the Annotated Corpora for Term Extraction Research (ACTER). The dataset covers three languages (English, French, and Dutch) and four domains, of which the domain of heart failure was kept as a held-out test set on which final f1-scores were calculated. The aim was to provide a large, transparent, qualitatively annotated, and diverse dataset to the ATE research community, with the goal of promoting comparative research and thus identifying strengths and weaknesses of various state-of-the-art methodologies. The results show a lot of variation between different systems and illustrate how some methodologies reach higher precision or recall, how different systems extract different types of terms, how some are exceptionally good at finding rare terms, or are less impacted by term length. The current contribution offers an overview of the shared task with a comparative evaluation, which complements the individual papers by all participants.
Anthology ID:
2020.computerm-1.12
Volume:
Proceedings of the 6th International Workshop on Computational Terminology
Month:
May
Year:
2020
Address:
Marseille, France
Editors:
Béatrice Daille, Kyo Kageura, Ayla Rigouts Terryn
Venue:
CompuTerm
SIG:
Publisher:
European Language Resources Association
Note:
Pages:
85–94
Language:
English
URL:
https://aclanthology.org/2020.computerm-1.12
DOI:
Bibkey:
Cite (ACL):
Ayla Rigouts Terryn, Veronique Hoste, Patrick Drouin, and Els Lefever. 2020. TermEval 2020: Shared Task on Automatic Term Extraction Using the Annotated Corpora for Term Extraction Research (ACTER) Dataset. In Proceedings of the 6th International Workshop on Computational Terminology, pages 85–94, Marseille, France. European Language Resources Association.
Cite (Informal):
TermEval 2020: Shared Task on Automatic Term Extraction Using the Annotated Corpora for Term Extraction Research (ACTER) Dataset (Rigouts Terryn et al., CompuTerm 2020)
Copy Citation:
PDF:
https://preview.aclanthology.org/nschneid-patch-4/2020.computerm-1.12.pdf
PDF Search