Katarzyna Lorenc
2025
Behind Closed Words: Creating and Investigating the forePLay Annotated Dataset for Polish Erotic Discourse
Anna Kołos
|
Katarzyna Lorenc
|
Emilia Wiśnios
|
Agnieszka Karlińska
Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
The surge in online content has created an urgent demand for robust detection systems, especially in non-English contexts where current tools demonstrate significant limitations. We introduce forePLay, a novel Polish-language dataset for erotic content detection, comprising over 24,000 annotated sentences. The dataset features a multidimensional taxonomy that captures ambiguity, violence, and socially unacceptable behaviors. Our comprehensive evaluation demonstrates that specialized Polish language models achieve superior performance compared to multilingual alternatives, with transformer-based architectures showing particular strength in handling imbalanced categories. The dataset and accompanying analysis establish essential frameworks for developing linguistically-aware content moderation systems, while highlighting critical considerations for extending such capabilities to morphologically complex languages.
PLLuM-Align: Polish Preference Dataset for Large Language Model Alignment
Karolina Seweryn
|
Anna Kołos
|
Agnieszka Karlińska
|
Katarzyna Lorenc
|
Katarzyna Dziewulska
|
Maciej Chrabaszcz
|
Aleksandra Krasnodebska
|
Paula Betscher
|
Zofia Cieślińska
|
Katarzyna Kowol
|
Julia Moska
|
Dawid Motyka
|
Paweł Walkowiak
|
Bartosz Żuk
|
Arkadiusz Janz
Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing
Alignment is the critical process of minimizing harmful outputs by teaching large language models (LLMs) to prefer safe, helpful and appropriate responses. While the majority of alignment research and datasets remain overwhelmingly English-centric, ensuring safety across diverse linguistic and cultural contexts requires localized resources. In this paper, we introduce the first Polish preference dataset PLLuM-Align, created entirely through human annotation to reflect Polish language and cultural nuances. The dataset includes response rating, ranking, and multi-turn dialog data. Designed to reflect the linguistic subtleties and cultural norms of Polish, this resource lays the groundwork for more aligned Polish LLMs and contributes to the broader goal of multilingual alignment in underrepresented languages.