CHILL at SemEval-2025 Task 2: You Can’t Just Throw Entities and Hope—Make Your LLM to Get Them Right

Jaebok Lee, Yonghyun Ryu, Seongmin Park, Yoonjung Choi


Abstract
In this paper, we describe our approach for the SemEval 2025 Task 2 on Entity-Aware Machine Translation (EA-MT).Our system aims to improve the accuracy of translating named entities by combining two key approaches: Retrieval Augmented Generation (RAG) and iterative self-refinement techniques using Large Language Models (LLMs).A distinctive feature of our system is its self-evaluation mechanism, where the LLM assesses its own translations based on two key criteria: the accuracy of entity translations and overall translation quality. We demonstrate how these methods work together and effectively improve entity handling while maintaining high-quality translations.
Anthology ID:
2025.semeval-1.75
Volume:
Proceedings of the 19th International Workshop on Semantic Evaluation (SemEval-2025)
Month:
July
Year:
2025
Address:
Vienna, Austria
Editors:
Sara Rosenthal, Aiala Rosá, Debanjan Ghosh, Marcos Zampieri
Venues:
SemEval | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
539–545
Language:
URL:
https://preview.aclanthology.org/corrections-2025-08/2025.semeval-1.75/
DOI:
Bibkey:
Cite (ACL):
Jaebok Lee, Yonghyun Ryu, Seongmin Park, and Yoonjung Choi. 2025. CHILL at SemEval-2025 Task 2: You Can’t Just Throw Entities and Hope—Make Your LLM to Get Them Right. In Proceedings of the 19th International Workshop on Semantic Evaluation (SemEval-2025), pages 539–545, Vienna, Austria. Association for Computational Linguistics.
Cite (Informal):
CHILL at SemEval-2025 Task 2: You Can’t Just Throw Entities and Hope—Make Your LLM to Get Them Right (Lee et al., SemEval 2025)
Copy Citation:
PDF:
https://preview.aclanthology.org/corrections-2025-08/2025.semeval-1.75.pdf