@inproceedings{kamsteeg-etal-2025-confidence,
    title = "Confidence Calibration in Large Language Model-Based Entity Matching",
    author = "Kamsteeg, Iris  and
      Cardenas-Cartagena, Juan  and
      van Beers, Floris  and
      Misikir Tashu, Tsegaye  and
      Valdenegro-Toro, Matias",
    editor = "Noidea, Noidea",
    booktitle = "Proceedings of the 2nd Workshop on Uncertainty-Aware NLP (UncertaiNLP 2025)",
    month = nov,
    year = "2025",
    address = "Suzhou, China",
    publisher = "Association for Computational Linguistics",
    url = "https://preview.aclanthology.org/ingest-emnlp/2025.uncertainlp-main.12/",
    pages = "120--137",
    ISBN = "979-8-89176-349-4",
    abstract = "This research aims to explore the intersection of Large Language Models and confidence calibration in Entity Matching. To this end, we perform an empirical study to compare baseline RoBERTa confidences for an Entity Matching task against confidences that are calibrated using Temperature Scaling, Monte Carlo Dropout and Ensembles. We use the Abt-Buy, DBLP-ACM, iTunes-Amazon and Company datasets. The findings indicate that the proposed modified RoBERTa model exhibits a slight overconfidence, with Expected Calibration Error scores ranging from 0.0043 to 0.0552 across datasets. We find that this overconfidence can be mitigated using Temperature Scaling, reducing Expected Calibration Error scores by up to 23.83{\%}."
}