Explainability of machine learning approaches in forensic linguistics: a case study in geolinguistic authorship profiling

Dana Roemling, Yves Scherrer, Aleksandra Miletić


Abstract
Forensic authorship profiling uses linguistic markers to infer characteristics about an author of a text. This task is paralleled in dialect classification, where a prediction is made about the linguistic variety of a text based on the text itself. While there have been significant advances in recent years in variety classification, forensic linguistics rarely relies on these approaches due to their lack of transparency, among other reasons. In this paper we therefore explore the explainability of machine learning approaches considering the forensic context. We focus on variety classification as a means of geolinguistic profiling of unknown texts based on social media data from the German-speaking area. For this, we identify the lexical items that are the most impactful for the variety classification. We find that the extracted lexical features are indeed representative of their respective varieties and note that the trained models also rely on place names for classifications.
Anthology ID:
2024.nlpaics-1.2
Volume:
Proceedings of the First International Conference on Natural Language Processing and Artificial Intelligence for Cyber Security
Month:
July
Year:
2024
Address:
Lancaster, UK
Editors:
Ruslan Mitkov, Saad Ezzini, Tharindu Ranasinghe, Ignatius Ezeani, Nouran Khallaf, Cengiz Acarturk, Matthew Bradbury, Mo El-Haj, Paul Rayson
Venue:
NLPAICS
SIG:
Publisher:
International Conference on Natural Language Processing and Artificial Intelligence for Cyber Security
Note:
Pages:
10–16
Language:
URL:
https://preview.aclanthology.org/fix-sig-urls/2024.nlpaics-1.2/
DOI:
Bibkey:
Cite (ACL):
Dana Roemling, Yves Scherrer, and Aleksandra Miletić. 2024. Explainability of machine learning approaches in forensic linguistics: a case study in geolinguistic authorship profiling. In Proceedings of the First International Conference on Natural Language Processing and Artificial Intelligence for Cyber Security, pages 10–16, Lancaster, UK. International Conference on Natural Language Processing and Artificial Intelligence for Cyber Security.
Cite (Informal):
Explainability of machine learning approaches in forensic linguistics: a case study in geolinguistic authorship profiling (Roemling et al., NLPAICS 2024)
Copy Citation:
PDF:
https://preview.aclanthology.org/fix-sig-urls/2024.nlpaics-1.2.pdf