AI Knows Where You Are: Exposure, Bias, and Inference in Multimodal Geolocation with KoreaGEO

Xiaonan Wang, Bo Shao, Hansaem Kim


Abstract
Recent advances in vision-language models (VLMs) have enabled accurate image-based geolocation, raising serious concerns about location privacy risks in everyday social media posts. Yet, a systematic evaluation of such risks is still lacking: existing benchmarks show coarse granularity, linguistic bias, and a neglect of multimodal privacy risks. To address these gaps, we introduce KoreaGEO, the first fine-grained, multimodal, and privacy-aware benchmark for geolocation, built on Korean street views. The benchmark covers four socio-spatial clusters and nine place types with rich contextual annotations and two captioning styles that simulate real-world privacy exposure. To evaluate mainstream VLMs, we design a three-path protocol spanning image-only, functional-caption, and high-risk-caption inputs, enabling systematic analysis of localization accuracy, spatial bias, and reasoning behavior. Results show that input modality exerts a stronger influence on localization precision and privacy exposure than model scale or architecture, with high-risk captions substantially boosting accuracy. Moreover, they highlight structural prediction biases toward core cities.
Anthology ID:
2025.emnlp-main.501
Volume:
Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing
Month:
November
Year:
2025
Address:
Suzhou, China
Editors:
Christos Christodoulopoulos, Tanmoy Chakraborty, Carolyn Rose, Violet Peng
Venue:
EMNLP
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
9897–9914
Language:
URL:
https://preview.aclanthology.org/ingest-emnlp/2025.emnlp-main.501/
DOI:
Bibkey:
Cite (ACL):
Xiaonan Wang, Bo Shao, and Hansaem Kim. 2025. AI Knows Where You Are: Exposure, Bias, and Inference in Multimodal Geolocation with KoreaGEO. In Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing, pages 9897–9914, Suzhou, China. Association for Computational Linguistics.
Cite (Informal):
AI Knows Where You Are: Exposure, Bias, and Inference in Multimodal Geolocation with KoreaGEO (Wang et al., EMNLP 2025)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-emnlp/2025.emnlp-main.501.pdf
Checklist:
 2025.emnlp-main.501.checklist.pdf