@inproceedings{palomino-etal-2025-edtec,
    title = "{E}d{T}ec-{I}tem{G}en: Enhancing Retrieval-Augmented Item Generation Through Key Point Extraction",
    author = {Palomino, Alonso  and
      Buschh{\"u}ter, David  and
      Roller, Roland  and
      Pinkwart, Niels  and
      Paassen, Benjamin},
    editor = "Zhang, Yuji  and
      Chen, Canyu  and
      Li, Sha  and
      Geva, Mor  and
      Han, Chi  and
      Wang, Xiaozhi  and
      Feng, Shangbin  and
      Gao, Silin  and
      Augenstein, Isabelle  and
      Bansal, Mohit  and
      Li, Manling  and
      Ji, Heng",
    booktitle = "Proceedings of the 3rd Workshop on Towards Knowledgeable Foundation Models (KnowFM)",
    month = aug,
    year = "2025",
    address = "Vienna, Austria",
    publisher = "Association for Computational Linguistics",
    url = "https://preview.aclanthology.org/acl25-workshop-ingestion/2025.knowfm-1.2/",
    pages = "14--25",
    ISBN = "979-8-89176-283-1",
    abstract = "A major bottleneck in exam construction involves designing test items (i.e., questions) that accurately reflect key content from domain-aligned curricular materials. For instance, during formative assessments in vocational education and training (VET), exam designers must generate updated test items that assess student learning progress while covering the full breadth of topics in the curriculum. Large language models (LLMs) can partially support this process, but effective use requires careful prompting and task-specific understanding. We propose a new key point extraction method for retrieval-augmented item generation that enhances the process of generating test items with LLMs. We exhaustively evaluated our method using a TREC-RAG approach, finding that prompting LLMs with key content rather than directly using full curricular text passages significantly improves item quality regarding key information coverage by 8{\%}. To demonstrate these findings, we release EdTec-ItemGen, a retrieval-augmented item generation demo tool to support item generation in education."
}