The Sonar Moment: An Audio Geo-Localization Benchmark for Audio-Language Models

Ruixing Zhang, Zihan Liu, Leilei Sun, Tongyu Zhu, Weifeng Lv


Abstract
Geo-localization aims to infer the geographic origin of a given signal. In computer vision, geo-localization has served as a demanding benchmark for compositional reasoning and is relevant to public safety. In contrast, progress on audio geo-localization has been constrained by the lack of high-quality audio-location pairs. To address this gap, we introduce AGL1K, the first audio geo-localization benchmark for audio language models (ALMs), spanning 72 countries and territories. To extract reliably localizable samples from a crowd-sourced platform, we propose the Audio Localizability metric that quantifies the informativeness of each recording, yielding 1,444 curated audio clips. Evaluations on 16 ALMs show that ALMs have emerged with audio geo-localization capability. We find that closed-source models substantially outperform open-source models, and that linguistic clues often dominate as a scaffold for prediction. We further analyze ALMs’ reasoning traces, regional bias, error causes, and the interpretability of the localizability metric. Overall, AGL1K establishes a benchmark for audio geo-localization and may advance ALMs with better geospatial reasoning capability.
Anthology ID:
2026.findings-acl.1297
Volume:
Findings of the Association for Computational Linguistics: ACL 2026
Month:
July
Year:
2026
Address:
San Diego, California, United States
Editors:
Maria Liakata, Viviane P. Moreira, Jiajun Zhang, David Jurgens
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
26045–26065
Language:
URL:
https://preview.aclanthology.org/ingest-acl/2026.findings-acl.1297/
DOI:
Bibkey:
Cite (ACL):
Ruixing Zhang, Zihan Liu, Leilei Sun, Tongyu Zhu, and Weifeng Lv. 2026. The Sonar Moment: An Audio Geo-Localization Benchmark for Audio-Language Models. In Findings of the Association for Computational Linguistics: ACL 2026, pages 26045–26065, San Diego, California, United States. Association for Computational Linguistics.
Cite (Informal):
The Sonar Moment: An Audio Geo-Localization Benchmark for Audio-Language Models (Zhang et al., Findings 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-acl/2026.findings-acl.1297.pdf
Checklist:
 2026.findings-acl.1297.checklist.pdf