Quantifying Misattribution Unfairness in Authorship Attribution
Pegah Alipoormolabashi, Ajay Patel, Niranjan Balasubramanian
Abstract
Authorship misattribution can have profound consequences in real life. In forensic settings simply being considered as one of the potential authors of an evidential piece of text or communication can result in undesirable scrutiny. This raises a fairness question: Is every author in the candidate pool at equal risk of misattribution? Standard evaluation measures for authorship attribution systems do not explicitly account for this notion of fairness. We introduce a simple measure, Misattribution Unfairness Index (MAUIk), which is based on how often authors are ranked in the top k for texts they did not write. Using this measure we quantify the unfairness of five models on two different datasets. All models exhibit high levels of unfairness with increased risks for some authors. Furthermore, we find that this unfairness relates to how the models embed the authors as vectors in the latent search space. In particular, we observe that the risk of misattribution is higher for authors closer to the centroid (or center) of the embedded authors in the haystack. These results indicate the potential for harm and the need for communicating with and calibrating end users on misattribution risk when building and providing such models for downstream use.- Anthology ID:
- 2025.acl-short.80
- Volume:
- Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers)
- Month:
- July
- Year:
- 2025
- Address:
- Vienna, Austria
- Editors:
- Wanxiang Che, Joyce Nabende, Ekaterina Shutova, Mohammad Taher Pilehvar
- Venue:
- ACL
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 1030–1041
- Language:
- URL:
- https://preview.aclanthology.org/ingestion-acl-25/2025.acl-short.80/
- DOI:
- Cite (ACL):
- Pegah Alipoormolabashi, Ajay Patel, and Niranjan Balasubramanian. 2025. Quantifying Misattribution Unfairness in Authorship Attribution. In Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), pages 1030–1041, Vienna, Austria. Association for Computational Linguistics.
- Cite (Informal):
- Quantifying Misattribution Unfairness in Authorship Attribution (Alipoormolabashi et al., ACL 2025)
- PDF:
- https://preview.aclanthology.org/ingestion-acl-25/2025.acl-short.80.pdf