AlphaBorno at BLP-2025 Task 2: Code Generation with Structured Prompts and Execution Feedback

Mohammad Ashfaq Ur Rahman, Muhtasim Ibteda Shochcho, Md Fahim


Abstract
This paper explores various prompting strategies in the BLP-2025 Shared Task 2, utilizing a pipeline that first translates Bangla problem descriptions into English with GPT-4o,then applies techniques like zero-shot, few-shot,chain of thought, synthetic test case integration, and a self-repair loop. We evaluated fourLLMs (GPT-4o, Grok-3, Claude 3.7 Sonnet,and Qwen2.5-Coder 14B). Our findings revealthat while traditional methods like few-shotand chain-of-thought prompting provided inconsistent gains, the integration of explicit unittests delivered a substantial performance boostacross all models. The most effective strategycombined zero-shot prompting with these synthetic tests and a self-repair loop, leading GPT4o to achieve a top Pass@1 score of 72.2%.These results represent the value of using explicit constraints and iterative feedback in codegeneration, offering a solid framework that improves the model’s code generation capabilities.
Anthology ID:
2025.banglalp-1.63
Volume:
Proceedings of the Second Workshop on Bangla Language Processing (BLP-2025)
Month:
December
Year:
2025
Address:
Mumbai, India
Editors:
Firoj Alam, Sudipta Kar, Shammur Absar Chowdhury, Naeemul Hassan, Enamul Hoque Prince, Mohiuddin Tasnim, Md Rashad Al Hasan Rony, Md Tahmid Rahman Rahman
Venues:
BanglaLP | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
615–623
Language:
URL:
https://preview.aclanthology.org/ingest-ijcnlp-aacl/2025.banglalp-1.63/
DOI:
Bibkey:
Cite (ACL):
Mohammad Ashfaq Ur Rahman, Muhtasim Ibteda Shochcho, and Md Fahim. 2025. AlphaBorno at BLP-2025 Task 2: Code Generation with Structured Prompts and Execution Feedback. In Proceedings of the Second Workshop on Bangla Language Processing (BLP-2025), pages 615–623, Mumbai, India. Association for Computational Linguistics.
Cite (Informal):
AlphaBorno at BLP-2025 Task 2: Code Generation with Structured Prompts and Execution Feedback (Rahman et al., BanglaLP 2025)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-ijcnlp-aacl/2025.banglalp-1.63.pdf