Toponym Resolution: Will Prompt Engineering Change Expectations?
Isuri Anuradha Nanomi Arachchige, Deshan Koshala Sumanathilaka, Ruslan Mitkov, Paul Rayson
Abstract
Deep Learning and, more recently, Large Language Models(LLMs) have revolutionised the field of artificial intelligence and have been successfully employed in many disciplines, capturing widespread attention and enthusiasm. Many previous studies have established that domain-specific Deep Learning models competitively perform with the general-purpose LLMs. However, a suitable prompt which provides direct instructions and background information is expected to yield improved results. The present study, which focuses on Large Language Models for Toponym Resolution, shows that effective Prompt Engineering techniques without fine-tuning or pre-training approaches enable LLMs to surpass Deep Learning models, which is contrary to the initial expectations. After a comparison of open-source and proprietary LLMs and different prompt engineering techniques, the GPT-4o model performs best compared to the other open-source LLMs.- Anthology ID:
- 2025.ranlp-1.11
- Volume:
- Proceedings of the 15th International Conference on Recent Advances in Natural Language Processing - Natural Language Processing in the Generative AI Era
- Month:
- September
- Year:
- 2025
- Address:
- Varna, Bulgaria
- Editors:
- Galia Angelova, Maria Kunilovskaya, Marie Escribe, Ruslan Mitkov
- Venue:
- RANLP
- SIG:
- Publisher:
- INCOMA Ltd., Shoumen, Bulgaria
- Note:
- Pages:
- 95–104
- Language:
- URL:
- https://preview.aclanthology.org/just-dir/2025.ranlp-1.11/
- DOI:
- Cite (ACL):
- Isuri Anuradha Nanomi Arachchige, Deshan Koshala Sumanathilaka, Ruslan Mitkov, and Paul Rayson. 2025. Toponym Resolution: Will Prompt Engineering Change Expectations?. In Proceedings of the 15th International Conference on Recent Advances in Natural Language Processing - Natural Language Processing in the Generative AI Era, pages 95–104, Varna, Bulgaria. INCOMA Ltd., Shoumen, Bulgaria.
- Cite (Informal):
- Toponym Resolution: Will Prompt Engineering Change Expectations? (Nanomi Arachchige et al., RANLP 2025)
- PDF:
- https://preview.aclanthology.org/just-dir/2025.ranlp-1.11.pdf