Evaluation of Failure Communication Strategies for Trust Repair in Human-AI Collaboration

Stina Klein, Alexandru Wurm, Elisabeth Andre, Matthias Kraus


Abstract
The increasing application of Large Language Models (LLMs) in everyday tasks and at work highlights the crucial importance of trust in human-AI collaboration, particularly when an AI system fails. This paper investigates the effectiveness of failure communication strategies for trust repair in collaborative physical tasks involving a a chat-based AI assistant. A controlled experiment in which participants built LEGO cars guided by an LLM-based AI Assistant was used to evaluate whether findings from trust repair in a virtual environment, such as chatbots, translate to an environment comprising tangible tasks, and whether the timing of trust repair influences the outcome. Results indicate that actively communicating mistakes significantly improves trust compared to a no repair strategy, and that early repair tends to be more effective, indicating that failure communication, independent of the timing, is important for an appropriate calibration of trust.
Anthology ID:
2026.lrec-main.230
Volume:
Proceedings of the Fifteenth Language Resources and Evaluation Conference
Month:
May
Year:
2026
Address:
Palma de Mallorca, Spain
Editors:
Stelios Piperidis, Núria Bel, Henk van den Heuvel, Nancy Ide, Simon Krek, Antonio Toral
Venue:
LREC
SIG:
Publisher:
ELRA Language Resource Association
Note:
Pages:
2942–2951
Language:
URL:
https://preview.aclanthology.org/ingest-lrec/2026.lrec-main.230/
DOI:
Bibkey:
Cite (ACL):
Stina Klein, Alexandru Wurm, Elisabeth Andre, and Matthias Kraus. 2026. Evaluation of Failure Communication Strategies for Trust Repair in Human-AI Collaboration. International Conference on Language Resources and Evaluation, main:2942–2951.
Cite (Informal):
Evaluation of Failure Communication Strategies for Trust Repair in Human-AI Collaboration (Klein et al., LREC 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-lrec/2026.lrec-main.230.pdf