@inproceedings{das-etal-2025-auditing,
    title = "Auditing Political Bias in Text Generation by {GPT}-4 using Sociocultural and Demographic Personas: Case of {B}engali Ethnolinguistic Communities",
    author = "Das, Dipto  and
      Ahmed, Syed Ishtiaque  and
      Guha, Shion",
    editor = "Bhattacharya, Arnab  and
      Goyal, Pawan  and
      Ghosh, Saptarshi  and
      Ghosh, Kripabandhu",
    booktitle = "Proceedings of the 1st Workshop on Benchmarks, Harmonization, Annotation, and Standardization for Human-Centric AI in Indian Languages (BHASHA 2025)",
    month = dec,
    year = "2025",
    address = "Mumbai, India",
    publisher = "Association for Computational Linguistics",
    url = "https://preview.aclanthology.org/ingest-ijcnlp-aacl/2025.bhasha-1.3/",
    pages = "23--36",
    ISBN = "979-8-89176-313-5",
    abstract = "Though large language models (LLMs) are increasingly used in multilingual contexts, their political and sociocultural biases in low-resource languages remain critically underexplored. In this paper, we investigate how LLM-generated texts in Bengali shift in response to personas with varying political orientations (left vs. right), religious identities (Hindu vs. Muslim), and national affiliations (Bangladeshi vs. Indian). In a quasi-experimental study, we simulate these personas and prompt an LLM to respond to political discussions. Measuring the shifts relative to responses for a baseline Bengali persona, we examined how political orientation influences LLM outputs, how topical association shape the political leanings of outputs, and how demographic persona-induced changes align with differently politically oriented variations. Our findings highlight left-leaning political bias in Bengali text generation and its significant association with Muslim sociocultural and demographic identity. We also connect our findings with broader discussions around emancipatory politics, epistemological considerations, and alignment of multilingual models."
}