Evaluation of Failure Communication Strategies for Trust Repair in Human-AI Collaboration
Stina Klein, Alexandru Wurm, Elisabeth Andre, Matthias Kraus
Abstract
The increasing application of Large Language Models (LLMs) in everyday tasks and at work highlights the crucial importance of trust in human-AI collaboration, particularly when an AI system fails. This paper investigates the effectiveness of failure communication strategies for trust repair in collaborative physical tasks involving a a chat-based AI assistant. A controlled experiment in which participants built LEGO cars guided by an LLM-based AI Assistant was used to evaluate whether findings from trust repair in a virtual environment, such as chatbots, translate to an environment comprising tangible tasks, and whether the timing of trust repair influences the outcome. Results indicate that actively communicating mistakes significantly improves trust compared to a no repair strategy, and that early repair tends to be more effective, indicating that failure communication, independent of the timing, is important for an appropriate calibration of trust.- Anthology ID:
- 2026.lrec-main.230
- Volume:
- Proceedings of the Fifteenth Language Resources and Evaluation Conference
- Month:
- May
- Year:
- 2026
- Address:
- Palma de Mallorca, Spain
- Editors:
- Stelios Piperidis, Núria Bel, Henk van den Heuvel, Nancy Ide, Simon Krek, Antonio Toral
- Venue:
- LREC
- SIG:
- Publisher:
- ELRA Language Resource Association
- Note:
- Pages:
- 2942–2951
- Language:
- URL:
- https://preview.aclanthology.org/ingest-lrec/2026.lrec-main.230/
- DOI:
- Cite (ACL):
- Stina Klein, Alexandru Wurm, Elisabeth Andre, and Matthias Kraus. 2026. Evaluation of Failure Communication Strategies for Trust Repair in Human-AI Collaboration. International Conference on Language Resources and Evaluation, main:2942–2951.
- Cite (Informal):
- Evaluation of Failure Communication Strategies for Trust Repair in Human-AI Collaboration (Klein et al., LREC 2026)
- PDF:
- https://preview.aclanthology.org/ingest-lrec/2026.lrec-main.230.pdf