@inproceedings{gritsai-etal-2024-multi,
    title = "Multi-head Span-based Detector for {AI}-generated Fragments in Scientific Papers",
    author = "Gritsai, German  and
      Khabutdinov, Ildar  and
      Grabovoy, Andrey",
    editor = "Ghosal, Tirthankar  and
      Singh, Amanpreet  and
      Waard, Anita  and
      Mayr, Philipp  and
      Naik, Aakanksha  and
      Weller, Orion  and
      Lee, Yoonjoo  and
      Shen, Shannon  and
      Qin, Yanxia",
    booktitle = "Proceedings of the Fourth Workshop on Scholarly Document Processing (SDP 2024)",
    month = aug,
    year = "2024",
    address = "Bangkok, Thailand",
    publisher = "Association for Computational Linguistics",
    url = "https://preview.aclanthology.org/jlcl-multiple-ingestion/2024.sdp-1.21/",
    pages = "220--225",
    abstract = "This paper describes a system designed to distinguish between AI-generated and human-written scientific excerpts in the DAGPap24 competition hosted within the Fourth Workshop on Scientific Document Processing. In this competition the task is to find artificially generated token-level text fragments in documents of a scientific domain. Our work focuses on the use of a multi-task learning architecture with two heads. The application of this approach is justified by the specificity of the task, where class spans are continuous over several hundred characters. We considered different encoder variations to obtain a state vector for each token in the sequence, as well as a variation in splitting fragments into tokens to further feed into the input of a transform-based encoder. This approach allows us to achieve a 9{\%} quality improvement relative to the baseline solution score on the development set (from 0.86 to 0.95) using the average macro $F_{1}$-score, as well as a score of 0.96 on a closed test part of the dataset from the competition."
}