Who Endorsed It? Measuring Authority Bias Across Expertise Levels in Language Models

Priyanka Mary Mammen, Emil Joswin, Shankar Venkitachalam


Abstract
Prior research demonstrates that the performance of language models on reasoning tasks can be influenced by suggestions, hints, and endorsements. However, the influence of endorsement source credibility remains underexplored. We investigate whether language models exhibit systematic bias based on the perceived expertise of the provider of the endorsement. Across 4 datasets spanning mathematical, legal, and medical reasoning, we evaluate 11 models using personas representing four expertise levels per domain. Our results reveal that models are increasingly susceptible to incorrect or misleading endorsements as source expertise increases, with higher-authority sources inducing not only accuracy degradation but also increased confidence in wrong answers. We also show that this authority bias is mechanistically encoded within the model and a model can be steered away from the bias, thereby improving its performance even when an expert gives a misleading endorsement.
Anthology ID:
2026.gem-main.75
Volume:
Proceedings of the Fifth Workshop on Generation, Evaluation and Metrics (GEM)
Month:
July
Year:
2026
Address:
San Diego, California, USA
Editors:
Simon Mille, Sebastian Gehrmann, Patrícia Schmidtová, Ondřej Dušek, Marzieh Fadaee, Kyle Lo, Enrico Santus, Gabriel Stanovsky
Venues:
GEM | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
980–989
Language:
URL:
https://preview.aclanthology.org/ingest-acl-workshops/2026.gem-main.75/
DOI:
Bibkey:
Cite (ACL):
Priyanka Mary Mammen, Emil Joswin, and Shankar Venkitachalam. 2026. Who Endorsed It? Measuring Authority Bias Across Expertise Levels in Language Models. In Proceedings of the Fifth Workshop on Generation, Evaluation and Metrics (GEM), pages 980–989, San Diego, California, USA. Association for Computational Linguistics.
Cite (Informal):
Who Endorsed It? Measuring Authority Bias Across Expertise Levels in Language Models (Mammen et al., GEM 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-acl-workshops/2026.gem-main.75.pdf