Ashutosh Dwivedi


2025

pdf bib
EtiCor++: Towards Understanding Etiquettical Bias in LLMs
Ashutosh Dwivedi | Siddhant Shivdutt Singh | Ashutosh Modi
Findings of the Association for Computational Linguistics: ACL 2025

In recent years, researchers have started analyzing the cultural sensitivity of LLMs. In this respect, Etiquettes have been an active area of research. Etiquettes are region-specific and are an essential part of the culture of a region; hence, it is imperative to make LLMs sensitive to etiquettes. However, there needs to be more resources in evaluating LLMs for their understanding and bias with regard to etiquettes. In this resource paper, we introduce EtiCor++, a corpus of etiquettes worldwide. We introduce different tasks for evaluating LLMs for knowledge about etiquettes across various regions. Further, we introduce various metrics for measuring bias in LLMs. Extensive experimentation with LLMs shows inherent bias towards certain regions.

2023

pdf bib
EtiCor: Corpus for Analyzing LLMs for Etiquettes
Ashutosh Dwivedi | Pradhyumna Lavania | Ashutosh Modi
Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing

Etiquettes are an essential ingredient of day-to-day interactions among people. Moreover, etiquettes are region-specific, and etiquettes in one region might contradict those in other regions. In this paper, we propose EtiCor, an Etiquettes Corpus, having texts about social norms from five different regions across the globe. The corpus provides a test bed for evaluating LLMs for knowledge and understanding of region-specific etiquettes. Additionally, we propose the task of Etiquette Sensitivity. We experiment with state-of-the-art LLMs (Delphi, Falcon40B, and GPT-3.5). Initial results indicate that LLMs, mostly fail to understand etiquettes from regions from non-Western world.