Lukas Rohde

Fixing paper assignments

  1. Please select all papers that belong to the same person.
  2. Indicate below which author they should be assigned to.
Provide a valid ORCID iD here. This will be used to match future papers to this author.
Provide the name of the school or the university where the author has received or will receive their highest degree (e.g., Ph.D. institution for researchers, or current affiliation for students). This will be used to form the new author page ID, if needed.

TODO: "submit" and "cancel" buttons here

2024

pdf bib
A Course Shared Task on Evaluating LLM Output for Clinical Questions
Yufang Hou | Thy Thy Tran | Doan Nam Long Vu | Yiwen Cao | Kai Li | Lukas Rohde | Iryna Gurevych
Proceedings of the Sixth Workshop on Teaching NLP

This paper presents a shared task that we organized at the Foundations of Language Technology (FoLT) course in 2023/2024 at the Technical University of Darmstadt, which focuses on evaluating the output of Large Language Models (LLMs) in generating harmful answers to health-related clinical questions. We describe the task design considerations and report the feedback we received from the students. We expect the task and the findings reported in this paper to be relevant for instructors teaching natural language processing (NLP).
Search
Co-authors
Venues
Fix data