Multi-Cultural Norm Base: Frame-based Norm Discovery in Multi-Cultural Settings
Viet Thanh Pham, Shilin Qu, Farhad Moghimifar, Suraj Sharma, Yuan-Fang Li, Weiqing Wang, Reza Haf
Abstract
Sociocultural norms serve as guiding principles for personal conduct in social interactions within a particular society or culture. The study of norm discovery has seen significant development over the last few years, with various interesting approaches. However, it is difficult to adopt these approaches to discover norms in a new culture, as they rely either on human annotations or real-world dialogue contents. This paper presents a robust automatic norm discovery pipeline, which utilizes the cultural knowledge of GPT-3.5 Turbo (ChatGPT) along with several social factors. By using these social factors and ChatGPT, our pipeline avoids the use of human dialogues that tend to be limited to specific scenarios, as well as the use of human annotations that make it difficult and costly to enlarge the dataset. The resulting database - Multi-cultural Norm Base (MNB) - covers 6 distinct cultures, with over 150k sociocultural norm statements in total. A state-of-the-art Large Language Model (LLM), Llama 3, fine-tuned with our proposed dataset, shows remarkable results on various downstream tasks, outperforming models fine-tuned on other datasets significantly.- Anthology ID:
- 2024.conll-1.3
- Volume:
- Proceedings of the 28th Conference on Computational Natural Language Learning
- Month:
- November
- Year:
- 2024
- Address:
- Miami, FL, USA
- Editors:
- Libby Barak, Malihe Alikhani
- Venue:
- CoNLL
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 24–35
- Language:
- URL:
- https://preview.aclanthology.org/build-pipeline-with-new-library/2024.conll-1.3/
- DOI:
- 10.18653/v1/2024.conll-1.3
- Cite (ACL):
- Viet Thanh Pham, Shilin Qu, Farhad Moghimifar, Suraj Sharma, Yuan-Fang Li, Weiqing Wang, and Reza Haf. 2024. Multi-Cultural Norm Base: Frame-based Norm Discovery in Multi-Cultural Settings. In Proceedings of the 28th Conference on Computational Natural Language Learning, pages 24–35, Miami, FL, USA. Association for Computational Linguistics.
- Cite (Informal):
- Multi-Cultural Norm Base: Frame-based Norm Discovery in Multi-Cultural Settings (Pham et al., CoNLL 2024)
- PDF:
- https://preview.aclanthology.org/build-pipeline-with-new-library/2024.conll-1.3.pdf