5ting at SemEval-2026 Task 8: Strong End-to-End Multi-Turn RAG via LLM-Based Reranking and Faithfulness Control
Thien-Qua T-Nguyen, Chi Hoang, Nguyen Tran, Tri Le, Khanh Truong, Chinh Nguyen
Abstract
This paper presents a modular multi-turn Retrieval-Augmented Generation (RAG) system designed to mitigate hallucination, context drift, and underspecification. The pipeline combines dual-query merged retrieval and LLM-based reranking to deliver high-precision evidence, improving nDCG@5 by 17.7%. To strictly control hallucination during generation, we introduce a role-separated prompting strategy. - This approach explicitly isolates the conversation history (used solely for intent and coreference resolution) from the retrieved passages (enforced as the exclusive source of factual grounding). - By preventing the language model from misinterpreting prior dialogue turns as factual evidence, the system ranked 3/29 in the SemEval-2026 Task 8 end-to-end evaluation. - Notably, our faithfulness-oriented design achieved a high ROUGE-L F1 score of 0.7692, outperforming larger baselines and demonstrating that explicit grounding constraints are highly effective at ensuring lexical faithfulness and reducing hallucinations.- Anthology ID:
- 2026.semeval-1.254
- Volume:
- Proceedings of the 20th International Workshop on Semantic Evaluation (2026)
- Month:
- July
- Year:
- 2026
- Address:
- San Diego, California, USA
- Editors:
- Ekaterina Kochmar, Debanjan Ghosh, Kai North, Mamoru Komachi
- Venues:
- SemEval | WS
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 2026–2033
- Language:
- URL:
- https://preview.aclanthology.org/ingest-acl-workshops/2026.semeval-1.254/
- DOI:
- Cite (ACL):
- Thien-Qua T-Nguyen, Chi Hoang, Nguyen Tran, Tri Le, Khanh Truong, and Chinh Nguyen. 2026. 5ting at SemEval-2026 Task 8: Strong End-to-End Multi-Turn RAG via LLM-Based Reranking and Faithfulness Control. In Proceedings of the 20th International Workshop on Semantic Evaluation (2026), pages 2026–2033, San Diego, California, USA. Association for Computational Linguistics.
- Cite (Informal):
- 5ting at SemEval-2026 Task 8: Strong End-to-End Multi-Turn RAG via LLM-Based Reranking and Faithfulness Control (T-Nguyen et al., SemEval 2026)
- PDF:
- https://preview.aclanthology.org/ingest-acl-workshops/2026.semeval-1.254.pdf