5ting at SemEval-2026 Task 8: Strong End-to-End Multi-Turn RAG via LLM-Based Reranking and Faithfulness Control

Thien-Qua T-Nguyen, Chi Hoang, Nguyen Tran, Tri Le, Khanh Truong, Chinh Nguyen


Abstract
This paper presents a modular multi-turn Retrieval-Augmented Generation (RAG) system designed to mitigate hallucination, context drift, and underspecification. The pipeline combines dual-query merged retrieval and LLM-based reranking to deliver high-precision evidence, improving nDCG@5 by 17.7%. To strictly control hallucination during generation, we introduce a role-separated prompting strategy. - This approach explicitly isolates the conversation history (used solely for intent and coreference resolution) from the retrieved passages (enforced as the exclusive source of factual grounding). - By preventing the language model from misinterpreting prior dialogue turns as factual evidence, the system ranked 3/29 in the SemEval-2026 Task 8 end-to-end evaluation. - Notably, our faithfulness-oriented design achieved a high ROUGE-L F1 score of 0.7692, outperforming larger baselines and demonstrating that explicit grounding constraints are highly effective at ensuring lexical faithfulness and reducing hallucinations.
Anthology ID:
2026.semeval-1.254
Volume:
Proceedings of the 20th International Workshop on Semantic Evaluation (2026)
Month:
July
Year:
2026
Address:
San Diego, California, USA
Editors:
Ekaterina Kochmar, Debanjan Ghosh, Kai North, Mamoru Komachi
Venues:
SemEval | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
2026–2033
Language:
URL:
https://preview.aclanthology.org/ingest-acl-workshops/2026.semeval-1.254/
DOI:
Bibkey:
Cite (ACL):
Thien-Qua T-Nguyen, Chi Hoang, Nguyen Tran, Tri Le, Khanh Truong, and Chinh Nguyen. 2026. 5ting at SemEval-2026 Task 8: Strong End-to-End Multi-Turn RAG via LLM-Based Reranking and Faithfulness Control. In Proceedings of the 20th International Workshop on Semantic Evaluation (2026), pages 2026–2033, San Diego, California, USA. Association for Computational Linguistics.
Cite (Informal):
5ting at SemEval-2026 Task 8: Strong End-to-End Multi-Turn RAG via LLM-Based Reranking and Faithfulness Control (T-Nguyen et al., SemEval 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-acl-workshops/2026.semeval-1.254.pdf
Supplementarymaterial:
 2026.semeval-1.254.SupplementaryMaterial.zip