Controlling Cross-Lingual Answer Distributions in Language Models: Enabling Transfer of Factual Preferences

Lukas Ellinger, Alexander Manev, Georg Groh


Abstract
Multilingual large language models exhibit systematic differences in their outputs across languages, even when representing the same underlying knowledge. Prior work has primarily focused on evaluating or reducing such inconsistencies. In this work, we instead study whether cross-lingual behavior can be controlled: specifically, whether answer distributions associated with other languages can be expressed under English prompting. To this end, we construct a human-annotated factual dataset and a cultural scenarios dataset, and compare intervention methods including persona prompting, activation steering, and preference-based fine-tuning. We evaluate how these methods affect answer distributions and their generalization to culturally grounded settings. Our results show that answer distributions can be systematically shifted toward those observed in other languages, with persona prompting consistently outperforming more complex intervention methods.
Anthology ID:
2026.stereacult-1.4
Volume:
Proceedings of the 1st Workshop on Stereotypes Across Cultures in Language Technologies (StereACuLT 2026)
Month:
July
Year:
2026
Address:
San Diego, California, United States
Editors:
Weicheng Ma, Soroush Vosoughi, Nabeel Gillani, Rolando Coto-Solano
Venues:
StereACuLT | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
35–49
Language:
URL:
https://preview.aclanthology.org/ingest-acl-workshops/2026.stereacult-1.4/
DOI:
Bibkey:
Cite (ACL):
Lukas Ellinger, Alexander Manev, and Georg Groh. 2026. Controlling Cross-Lingual Answer Distributions in Language Models: Enabling Transfer of Factual Preferences. In Proceedings of the 1st Workshop on Stereotypes Across Cultures in Language Technologies (StereACuLT 2026), pages 35–49, San Diego, California, United States. Association for Computational Linguistics.
Cite (Informal):
Controlling Cross-Lingual Answer Distributions in Language Models: Enabling Transfer of Factual Preferences (Ellinger et al., StereACuLT 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-acl-workshops/2026.stereacult-1.4.pdf