Changes in Tweet Geolocation over Time: A Study with Carmen 2.0

Jingyu Zhang, Alexandra DeLucia, Mark Dredze


Abstract
Researchers across disciplines use Twitter geolocation tools to filter data for desired locations. These tools have largely been trained and tested on English tweets, often originating in the United States from almost a decade ago. Despite the importance of these tools for data curation, the impact of tweet language, country of origin, and creation date on tool performance remains largely unknown. We explore these issues with Carmen, a popular tool for Twitter geolocation. To support this study we introduce Carmen 2.0, a major update which includes the incorporation of GeoNames, a gazetteer that provides much broader coverage of locations. We evaluate using two new Twitter datasets, one for multilingual, multiyear geolocation evaluation, and another for usage trends over time. We found that language, country origin, and time does impact geolocation tool performance.
Anthology ID:
2022.wnut-1.1
Volume:
Proceedings of the Eighth Workshop on Noisy User-generated Text (W-NUT 2022)
Month:
October
Year:
2022
Address:
Gyeongju, Republic of Korea
Venue:
WNUT
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
1–14
Language:
URL:
https://aclanthology.org/2022.wnut-1.1
DOI:
Bibkey:
Cite (ACL):
Jingyu Zhang, Alexandra DeLucia, and Mark Dredze. 2022. Changes in Tweet Geolocation over Time: A Study with Carmen 2.0. In Proceedings of the Eighth Workshop on Noisy User-generated Text (W-NUT 2022), pages 1–14, Gyeongju, Republic of Korea. Association for Computational Linguistics.
Cite (Informal):
Changes in Tweet Geolocation over Time: A Study with Carmen 2.0 (Zhang et al., WNUT 2022)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingestion-script-update/2022.wnut-1.1.pdf
Code
 mdredze/carmen-python