HausaNLP at SemEval-2026 Task 7: Prompt-based Hausa Cultural Question Answering

Faisal Adam, Lukman Aliyu, Sani Aji, Abdulhamid Abubakar, Aliyu Rabiu Shuaibu


Abstract
We describe HausaNLP’s submission toSemEval-2026 Task 7 Track 1 (short-answercultural question answering). Our system is atraining-free, prompt-based pipeline targetingnative Hausa (ha-NG). Two design decisionsdistinguish it from a generic zero-shot baseline.We use locale-conditional prompting: ha-NGquestions receive a system prompt instructingconcise standard Hausa output with explicitBoko-script characters (á, â, Î, ű). Second, weuse a two-model fallback pipeline: GPT-4o handles the primary pass, and Gemini 1.5 Flash retries any rows where the primary call returnedan error or empty output, separating modelknowledge failures from API-availability failures. On the official development leaderboard,our best run reached 36.4 accuracy. Error analysis shows that a non-trivial fraction of failures are placeholder strings caused by APIerrors rather than incorrect generations, andthat surface-level mismatches (verbosity, orthographic variation) account for many of the remaining errors. Code, prompts, and processingscripts are released for reproducibility.
Anthology ID:
2026.semeval-1.218
Volume:
Proceedings of the 20th International Workshop on Semantic Evaluation (2026)
Month:
July
Year:
2026
Address:
San Diego, California, USA
Editors:
Ekaterina Kochmar, Debanjan Ghosh, Kai North, Mamoru Komachi
Venues:
SemEval | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
1701–1706
Language:
URL:
https://preview.aclanthology.org/ingest-acl-workshops/2026.semeval-1.218/
DOI:
Bibkey:
Cite (ACL):
Faisal Adam, Lukman Aliyu, Sani Aji, Abdulhamid Abubakar, and Aliyu Rabiu Shuaibu. 2026. HausaNLP at SemEval-2026 Task 7: Prompt-based Hausa Cultural Question Answering. In Proceedings of the 20th International Workshop on Semantic Evaluation (2026), pages 1701–1706, San Diego, California, USA. Association for Computational Linguistics.
Cite (Informal):
HausaNLP at SemEval-2026 Task 7: Prompt-based Hausa Cultural Question Answering (Adam et al., SemEval 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-acl-workshops/2026.semeval-1.218.pdf