From Word to World: Evaluate and Mitigate Culture Bias in LLMs via Word Association Test

Xunlian Dai, Li Zhou, Benyou Wang, Haizhou Li


Abstract
The human-centered word association test (WAT) serves as a cognitive proxy, revealing sociocultural variations through culturally shared semantic expectations and implicit linguistic patterns shaped by lived experiences. We extend this test into an LLM-adaptive, free-relation task to assess the alignment of large language models (LLMs) with cross-cultural cognition. To address culture preference, we propose CultureSteer, an innovative approach that moves beyond superficial cultural prompting by embedding cultural-specific semantic associations directly within the model’s internal representation space. Experiments show that current LLMs exhibit significant bias toward Western (notably American) schemas at the word association level. In contrast, our model substantially improves cross-cultural alignment, capturing diverse semantic associations. Further validation on culture-sensitive downstream tasks confirms its efficacy in fostering cognitive alignment across cultures. This work contributes a novel methodological paradigm for enhancing cultural awareness in LLMs, advancing the development of more inclusive language technologies.
Anthology ID:
2025.emnlp-main.1246
Volume:
Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing
Month:
November
Year:
2025
Address:
Suzhou, China
Editors:
Christos Christodoulopoulos, Tanmoy Chakraborty, Carolyn Rose, Violet Peng
Venue:
EMNLP
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
24521–24537
Language:
URL:
https://preview.aclanthology.org/ingest-emnlp/2025.emnlp-main.1246/
DOI:
Bibkey:
Cite (ACL):
Xunlian Dai, Li Zhou, Benyou Wang, and Haizhou Li. 2025. From Word to World: Evaluate and Mitigate Culture Bias in LLMs via Word Association Test. In Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing, pages 24521–24537, Suzhou, China. Association for Computational Linguistics.
Cite (Informal):
From Word to World: Evaluate and Mitigate Culture Bias in LLMs via Word Association Test (Dai et al., EMNLP 2025)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-emnlp/2025.emnlp-main.1246.pdf
Checklist:
 2025.emnlp-main.1246.checklist.pdf