@inproceedings{przybyla-etal-2025-poleval,
    title = "{P}ol{E}val 2025 Task 1 {\'S}migiel: Spotting Machine-Generated Text from {LLM}s for {P}olish",
    author = "Przyby{\l}a, Piotr  and
      Strebeyko, Jakub  and
      Wr{\'o}blewska, Alina",
    editor = "Kobyli{\'n}ski, {\L}ukasz  and
      Wr{\'o}blewska, Alina  and
      Ogrodniczuk, Maciej",
    booktitle = "Proceedings of the {P}ol{E}val 2025 Workshop",
    month = nov,
    year = "2025",
    address = "Warsaw",
    publisher = "Institute of Computer Science PAS and Association for Computational Linguistics",
    url = "https://preview.aclanthology.org/ingest-paclic/2025.poleval-main.2/",
    pages = "5--15",
    abstract = "This paper introduces the first shared task on machine-generated text (MGT) detection for Polish, organised as part of the PolEval 2025 evaluation campaign. The task evaluates participating systems under three scenarios {---} unsupervised, constrained, and open {---} designed to reflect different levels of access to training data. In total, seven systems were submitted.The results indicate that MGT detection for Polish is feasible, with the best-performing constrained systems achieving over 90{\%} accuracy on the main evaluation set. However, performance drops when models are tested on unseen domains or generator models, revealing substantial limitations in generalisation. In the most challenging settings, unsupervised approaches perform better, despite achieving overall lower performance.This shared task establishes a new benchmark for MGT detection in Polish. The publicly released {\'S}migiel dataset is intended to support future research on robust and generalisable MGT detection methods."
}