Howard University-AI4PC at SemEval-2026 Task 8: Query Reformulation and Dense-Lexical Retrieval Fusion for Multi-Turn Retrieval-Augmented Generation

Sijan Shrestha, Saurav Aryal


Abstract
We present a training-free hybrid retrieve-then-rerank system for multi-turn retrieval-augmented generation, submitted to allthree subtasks of SemEval-2026 Task 8(MTRAGEval): passage retrieval (Task A),generation with reference passages (Task B),and end-to-end RAG (Task C). Our system ad-dresses the core multi-turn challenges—non-standalone questions, unanswerable queries,and shifting passage relevance—across fourdomain-specific corpora: ClapNQ, Cloud,FiQA, and Govt. Queries are reformulatedthrough LLM-driven rewriting, decompositioninto sub-queries, and Hypothetical DocumentEmbeddings (HyDE). Retrieved candidatesfrom dense vector search (BGE-base-en-v1.5)and BM25 lexical matching are fused via Re-ciprocal Rank Fusion and reranked by a cross-encoder (BGE-reranker-large). Llama-3.3-70B-Instruct generates extractive, context-groundedresponses with built-in abstention for unanswer-able queries. Using only open-source mod-els without fine-tuning, the system achievesnDCG@5 of 0.4098 on Task A (22nd/38), aharmonic mean of 0.7462 on Task B (9th/26),and 0.5796 on Task C (2nd/29), coming within1.1% of the top submission. We attribute thestrong Task C result to the synergy betweenmulti-signal query reformulation and faithfulextractive generation.
Anthology ID:
2026.semeval-1.320
Volume:
Proceedings of the 20th International Workshop on Semantic Evaluation (2026)
Month:
July
Year:
2026
Address:
San Diego, California, USA
Editors:
Ekaterina Kochmar, Debanjan Ghosh, Kai North, Mamoru Komachi
Venues:
SemEval | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
2533–2539
Language:
URL:
https://preview.aclanthology.org/ingest-acl-workshops/2026.semeval-1.320/
DOI:
Bibkey:
Cite (ACL):
Sijan Shrestha and Saurav Aryal. 2026. Howard University-AI4PC at SemEval-2026 Task 8: Query Reformulation and Dense-Lexical Retrieval Fusion for Multi-Turn Retrieval-Augmented Generation. In Proceedings of the 20th International Workshop on Semantic Evaluation (2026), pages 2533–2539, San Diego, California, USA. Association for Computational Linguistics.
Cite (Informal):
Howard University-AI4PC at SemEval-2026 Task 8: Query Reformulation and Dense-Lexical Retrieval Fusion for Multi-Turn Retrieval-Augmented Generation (Shrestha & Aryal, SemEval 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-acl-workshops/2026.semeval-1.320.pdf