Reading between the Lines: Can LLMs Identify Cross-Cultural Communication Gaps?

Sougata Saha, Saurabh Kumar Pandey, Harshit Gupta, Monojit Choudhury


Abstract
In a rapidly globalizing and digital world, content such as book and product reviews created by people from diverse cultures are read and consumed by others from different corners of the world. In this paper, we investigate the extent and patterns of gaps in understandability of book reviews due to the presence of culturally-specific items and elements that might be alien to users from another culture. Our user-study on 57 book reviews from Goodreads reveal that 83% of the reviews had at least one culture-specific difficult-to-understand element. We also evaluate the efficacy of GPT-4o in identifying such items, given the cultural background of the reader; the results are mixed, implying a significant scope for improvement. Our datasets are available here: https://github.com/sougata-ub/reading_between_lines.
Anthology ID:
2025.naacl-long.409
Volume:
Proceedings of the 2025 Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers)
Month:
April
Year:
2025
Address:
Albuquerque, New Mexico
Editors:
Luis Chiruzzo, Alan Ritter, Lu Wang
Venue:
NAACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
8043–8067
Language:
URL:
https://preview.aclanthology.org/fix-sig-urls/2025.naacl-long.409/
DOI:
Bibkey:
Cite (ACL):
Sougata Saha, Saurabh Kumar Pandey, Harshit Gupta, and Monojit Choudhury. 2025. Reading between the Lines: Can LLMs Identify Cross-Cultural Communication Gaps?. In Proceedings of the 2025 Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers), pages 8043–8067, Albuquerque, New Mexico. Association for Computational Linguistics.
Cite (Informal):
Reading between the Lines: Can LLMs Identify Cross-Cultural Communication Gaps? (Saha et al., NAACL 2025)
Copy Citation:
PDF:
https://preview.aclanthology.org/fix-sig-urls/2025.naacl-long.409.pdf