@inproceedings{tahaei-etal-2024-efficient,
    title = "Efficient Citer: Tuning Large Language Models for Enhanced Answer Quality and Verification",
    author = "Tahaei, Marzieh  and
      Jafari, Aref  and
      Rashid, Ahmad  and
      Alfonso-Hermelo, David  and
      Bibi, Khalil  and
      Wu, Yimeng  and
      Ghodsi, Ali  and
      Chen, Boxing  and
      Rezagholizadeh, Mehdi",
    editor = "Duh, Kevin  and
      Gomez, Helena  and
      Bethard, Steven",
    booktitle = "Findings of the Association for Computational Linguistics: NAACL 2024",
    month = jun,
    year = "2024",
    address = "Mexico City, Mexico",
    publisher = "Association for Computational Linguistics",
    url = "https://preview.aclanthology.org/jlcl-multiple-ingestion/2024.findings-naacl.277/",
    doi = "10.18653/v1/2024.findings-naacl.277",
    pages = "4443--4450",
    abstract = "In recent years, there has been a growing interest in utilizing external knowledge to reduce hallucinations in large language models (LLMs) and provide them with updated information. Despite this improvement, a major challenge lies in the lack of explicit citations, which hampers the ability to verify the information generated by these models.This paper focuses on providing models with citation capabilities efficiently. By constructing a dataset of citations, we train two model architectures: an FID-style FLAN-T5 model for efficient answer composition and a 13B model known for its success in instruction following after tuning. Evaluation on fluency, correctness, and citation quality is conducted through human assessment and the newly introduced Automatic LLMs' Citation Evaluation (ALCE) benchmark.Results demonstrate significant improvements in answer quality and efficiency, surpassing the performance of the popular ChatGPT on some of the metrics. The models exhibit exceptional out-of-domain generalization in both human and automatic evaluation. Notably, the FID-style FLAN-T5 model with only 3B parameters performs impressively compared to the 13B model."
}