@inproceedings{fatahi-bayat-etal-2024-enhanced,
    title = "Enhanced Language Model Truthfulness with Learnable Intervention and Uncertainty Expression",
    author = "Fatahi Bayat, Farima  and
      Liu, Xin  and
      Jagadish, H.  and
      Wang, Lu",
    editor = "Ku, Lun-Wei  and
      Martins, Andre  and
      Srikumar, Vivek",
    booktitle = "Findings of the Association for Computational Linguistics: ACL 2024",
    month = aug,
    year = "2024",
    address = "Bangkok, Thailand",
    publisher = "Association for Computational Linguistics",
    url = "https://preview.aclanthology.org/fix-sig-urls/2024.findings-acl.737/",
    doi = "10.18653/v1/2024.findings-acl.737",
    pages = "12388--12400",
    abstract = "Large language models (LLMs) can generate long-form and coherent text, yet they often hallucinate facts, which undermines their reliability. To mitigate this issue, inference-time methods steer LLM representations toward the ``truthful directions'' previously learned for truth elicitation. However, applying these truthful directions with the same intensity fails to generalize across different query contexts. We propose LITO, a Learnable Intervention method for Truthfulness Optimization that automatically identifies the optimal intervention intensity tailored to each specific context. LITO explores a sequence of model generations based on increasing levels of intervention intensities. It selects the most accurate response or refuses to answer when the predictions are highly uncertain. Experiments on multiple LLMs and question-answering datasets demonstrate that LITO improves truthfulness while preserving task accuracy. The adaptive nature of LITO counters the limitations of one-size-fits-all intervention methods, maximizing truthfulness by reflecting the model{'}s internal knowledge only when it is confident. Our code is available at https://github.com/launchnlp/LITO."
}