@inproceedings{agarwala-etal-2025-code,
    title = "{C}ode{\_}{G}en at {BLP}-2025 Task 2: {B}angla{C}ode: A Cross-lingual Benchmark for Code Generation with Translation and Assertion Strategies",
    author = "Agarwala, Abhishek  and
      Islam, Shifat  and
      Ghosh, Emon",
    editor = "Alam, Firoj  and
      Kar, Sudipta  and
      Chowdhury, Shammur Absar  and
      Hassan, Naeemul  and
      Prince, Enamul Hoque  and
      Tasnim, Mohiuddin  and
      Rony, Md Rashad Al Hasan  and
      Rahman, Md Tahmid Rahman",
    booktitle = "Proceedings of the Second Workshop on Bangla Language Processing (BLP-2025)",
    month = dec,
    year = "2025",
    address = "Mumbai, India",
    publisher = "Association for Computational Linguistics",
    url = "https://preview.aclanthology.org/ingest-ijcnlp-aacl/2025.banglalp-1.68/",
    pages = "663--668",
    ISBN = "979-8-89176-314-2",
    abstract = "Large Language Models (LLMs) have shown great code-generation capabilities, but their performance in low-resource languages like Bangla is largely unexplored. We participated in BLP-2025 Task 2: Code Generation in Bangla, where we built a pipeline to interpret and execute Bangla instructions using GPT-5. Extensive experiments were conducted with proprietary (GPT-4o Mini, GPT-5 Mini, GPT-5) and open-source (LLaMA 3-8B, TigerLLM-1B-it) models under translation and assertion settings. Results show that GPT-5, with translation and assertion, scored 83.8{\%}, outperformed all baselines, while open-source models lagged due to limited Bangla adaptation. Assertion-based prompting always improved syntactic correctness, and fine-tuning reduced hallucinations across open-source models. We ranked 7th on the official leaderboard with an approach which is competitive and generalizable. Overall, our results show that translation quality, data normalization, and prompt design are key components of low-resource code generation. Furthermore, the proposed BanglaCode benchmark and preprocessing architecture provide a basis for further multilingual code-generation research."
}