silp_nlp at SemEval-2025 Task 2: An Effect of Entity Awareness in Machine Translation Using LLM

Sumit Singh, Pankaj Goyal, Uma Tiwary


Abstract
In this study, we investigated the effect of entity awareness on machine translation (MT) using large language models (LLMs). Our approach utilized GPT-4o and NLLB-200, integrating named entity recognition (NER) to improve translation quality. The results indicated that incorporating entity information enhanced translation accuracy, especially when dealing with named entities. However, performance was highly dependent on the effectiveness of the NER model.
Anthology ID:
2025.semeval-1.310
Volume:
Proceedings of the 19th International Workshop on Semantic Evaluation (SemEval-2025)
Month:
July
Year:
2025
Address:
Vienna, Austria
Editors:
Sara Rosenthal, Aiala Rosá, Debanjan Ghosh, Marcos Zampieri
Venues:
SemEval | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
2389–2394
Language:
URL:
https://preview.aclanthology.org/corrections-2025-08/2025.semeval-1.310/
DOI:
Bibkey:
Cite (ACL):
Sumit Singh, Pankaj Goyal, and Uma Tiwary. 2025. silp_nlp at SemEval-2025 Task 2: An Effect of Entity Awareness in Machine Translation Using LLM. In Proceedings of the 19th International Workshop on Semantic Evaluation (SemEval-2025), pages 2389–2394, Vienna, Austria. Association for Computational Linguistics.
Cite (Informal):
silp_nlp at SemEval-2025 Task 2: An Effect of Entity Awareness in Machine Translation Using LLM (Singh et al., SemEval 2025)
Copy Citation:
PDF:
https://preview.aclanthology.org/corrections-2025-08/2025.semeval-1.310.pdf