UAlberta at SemEval-2025 Task 2: Prompting and Ensembling for Entity-Aware Translation
Ning Shi, David Basil, Bradley Hauer, Noshin Nawal, Jai Riley, Daniela Teodorescu, John Zhang, Grzegorz Kondrak
Abstract
We describe the methods used by our UAlberta team for the SemEval-2025 Task 2 on Entity-Aware Machine Translation (EA-MT). Our methods leverage large language models with prompt engineering strategies suited to this task, including retrieval augmented generation and in-context learning. Our best results overall are obtained with ensembles of multiple models, leveraging named entity knowledge in the dataset. Finally, we provide proof-of-concept experiments showing that lexico-semantic knowledge can be used to identify high-quality translations. We further demonstrate that our methods can function even without gold named entity translations, by using an alternative knowledge base such as BabelNet.- Anthology ID:
- 2025.semeval-1.224
- Volume:
- Proceedings of the 19th International Workshop on Semantic Evaluation (SemEval-2025)
- Month:
- July
- Year:
- 2025
- Address:
- Vienna, Austria
- Editors:
- Sara Rosenthal, Aiala Rosá, Debanjan Ghosh, Marcos Zampieri
- Venues:
- SemEval | WS
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 1709–1717
- Language:
- URL:
- https://preview.aclanthology.org/transition-to-people-yaml/2025.semeval-1.224/
- DOI:
- Cite (ACL):
- Ning Shi, David Basil, Bradley Hauer, Noshin Nawal, Jai Riley, Daniela Teodorescu, John Zhang, and Grzegorz Kondrak. 2025. UAlberta at SemEval-2025 Task 2: Prompting and Ensembling for Entity-Aware Translation. In Proceedings of the 19th International Workshop on Semantic Evaluation (SemEval-2025), pages 1709–1717, Vienna, Austria. Association for Computational Linguistics.
- Cite (Informal):
- UAlberta at SemEval-2025 Task 2: Prompting and Ensembling for Entity-Aware Translation (Shi et al., SemEval 2025)
- PDF:
- https://preview.aclanthology.org/transition-to-people-yaml/2025.semeval-1.224.pdf