@inproceedings{papakonstantinou-etal-2025-evaluating,
    title = "Evaluating Large Language Models for Belief Inference: Mapping Belief Networks at Scale",
    author = "Papakonstantinou, Trisevgeni  and
      Zhiteneva, Antonina  and
      Ma, Ana Yutong  and
      Powell, Derek  and
      Horne, Zachary",
    editor = "Christodoulopoulos, Christos  and
      Chakraborty, Tanmoy  and
      Rose, Carolyn  and
      Peng, Violet",
    booktitle = "Findings of the Association for Computational Linguistics: EMNLP 2025",
    month = nov,
    year = "2025",
    address = "Suzhou, China",
    publisher = "Association for Computational Linguistics",
    url = "https://preview.aclanthology.org/author-page-yu-wang-polytechnic/2025.findings-emnlp.1132/",
    doi = "10.18653/v1/2025.findings-emnlp.1132",
    pages = "20787--20795",
    ISBN = "979-8-89176-335-7",
    abstract = "Beliefs are interconnected, influencing how people process and update what they think. To study the interconnectedness of beliefs at scale, we introduce a novel analytical pipeline leveraging a finetuned GPT-4o model to infer belief structures from large-scale social media data. We evaluate the model{'}s performance by (1) comparing it to human annotated data (2) and its inferences to human-generated survey data. Our results show that a fine-tuned GPT-4o model can effectively recover belief structures, allowing for a level of scalability and efficiency that is impossible using traditional survey methods of data collection. This work demonstrates the potential for large language models to perform belief inference tasks and provides a framework for future research on the analysis of belief structures."
}