@inproceedings{xu-etal-2025-language,
    title = "Do Language Models Mirror Human Confidence? Exploring Psychological Insights to Address Overconfidence in {LLM}s",
    author = "Xu, Chenjun  and
      Wen, Bingbing  and
      Han, Bin  and
      Wolfe, Robert  and
      Wang, Lucy Lu  and
      Howe, Bill",
    editor = "Che, Wanxiang  and
      Nabende, Joyce  and
      Shutova, Ekaterina  and
      Pilehvar, Mohammad Taher",
    booktitle = "Findings of the Association for Computational Linguistics: ACL 2025",
    month = jul,
    year = "2025",
    address = "Vienna, Austria",
    publisher = "Association for Computational Linguistics",
    url = "https://preview.aclanthology.org/mtsummit-25-ingestion/2025.findings-acl.1316/",
    doi = "10.18653/v1/2025.findings-acl.1316",
    pages = "25655--25672",
    ISBN = "979-8-89176-256-5",
    abstract = "Psychology research has shown that humans are poor at estimating their performance on tasks, tending towards underconfidence on easy tasks and overconfidence on difficult tasks. We examine three LLMs, Llama-3-70B-instruct, Claude-3-Sonnet, and GPT-4o, on a range of QA tasks of varying difficulty, and show that models exhibit subtle differences from human patterns of overconfidence: less sensitive to task difficulty, and when prompted to answer based on different personas{---}e.g., expert vs layman, or different race, gender, and ages{---}the models will respond with stereotypically biased confidence estimations even though their underlying answer accuracy remains the same. Based on these observations, we propose Answer-Free Confidence Estimation (AFCE) to improve confidence calibration and LLM interpretability in these settings. AFCE is a self-assessment method that employs two stages of prompting, first eliciting only confidence scores on questions, then asking separately for the answer. Experiments on the MMLU and GPQA datasets spanning subjects and difficulty show that this separation of tasks significantly reduces overconfidence and delivers more human-like sensitivity to task difficulty."
}