Use of NLP in the Context of Belief states of Ethnic Minorities in Latin America

Olga Kellert, Mahmud Zaman


Abstract
The major goal of our study is to test methodsin NLP in the domain of health care educationrelated to Covid-19 of vulnerable groups suchas indigenous people from Latin America. Inorder to achieve this goal, we asked participantsin a survey questionnaire to provide answersabout health related topics. We used these answersto measure the health education status ofour participants. In this paper, we summarizethe results from our NLP-application on theparticipants’ answers. In the first experiment,we use embeddings-based tools to measure thesemantic similarity between participants’ answersand “expert” or “reference” answers. Inthe second experiment, we use synonym-basedmethods to classify answers under topics. Wecompare the results from both experiments withhuman annotations. Our results show that thetested NLP-methods reach a significantly loweraccuracy score than human annotations in bothexperiments. We explain this difference by theassumption that human annotators are muchbetter in pragmatic inferencing necessary toclassify the semantic similarity and topic classificationof answers.
Anthology ID:
2023.americasnlp-1.1
Volume:
Proceedings of the Workshop on Natural Language Processing for Indigenous Languages of the Americas (AmericasNLP)
Month:
July
Year:
2023
Address:
Toronto, Canada
Venue:
AmericasNLP
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
1–5
Language:
URL:
https://aclanthology.org/2023.americasnlp-1.1
DOI:
Bibkey:
Cite (ACL):
Olga Kellert and Mahmud Zaman. 2023. Use of NLP in the Context of Belief states of Ethnic Minorities in Latin America. In Proceedings of the Workshop on Natural Language Processing for Indigenous Languages of the Americas (AmericasNLP), pages 1–5, Toronto, Canada. Association for Computational Linguistics.
Cite (Informal):
Use of NLP in the Context of Belief states of Ethnic Minorities in Latin America (Kellert & Zaman, AmericasNLP 2023)
Copy Citation:
PDF:
https://preview.aclanthology.org/starsem-semeval-split/2023.americasnlp-1.1.pdf