Abstract
This report describes the course Evaluation of NLP Systems, taught for Computational Linguistics undergraduate students during the winter semester 20/21 at the University of Potsdam, Germany. It was a discussion-based seminar that covered different aspects of evaluation in NLP, namely paradigms, common procedures, data annotation, metrics and measurements, statistical significance testing, best practices and common approaches in specific NLP tasks and applications.- Anthology ID:
- 2021.teachingnlp-1.14
- Volume:
- Proceedings of the Fifth Workshop on Teaching NLP
- Month:
- June
- Year:
- 2021
- Address:
- Online
- Editors:
- David Jurgens, Varada Kolhatkar, Lucy Li, Margot Mieskes, Ted Pedersen
- Venue:
- TeachingNLP
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 87–91
- Language:
- URL:
- https://aclanthology.org/2021.teachingnlp-1.14
- DOI:
- 10.18653/v1/2021.teachingnlp-1.14
- Cite (ACL):
- Brielen Madureira. 2021. Flamingos and Hedgehogs in the Croquet-Ground: Teaching Evaluation of NLP Systems for Undergraduate Students. In Proceedings of the Fifth Workshop on Teaching NLP, pages 87–91, Online. Association for Computational Linguistics.
- Cite (Informal):
- Flamingos and Hedgehogs in the Croquet-Ground: Teaching Evaluation of NLP Systems for Undergraduate Students (Madureira, TeachingNLP 2021)
- PDF:
- https://preview.aclanthology.org/bionlp-24-ingestion/2021.teachingnlp-1.14.pdf