@inproceedings{brinner-zarriess-2025-efficient,
    title = "Efficient Scientific Full Text Classification: {The} Case of {EICAT} Impact Assessments",
    author = "Brinner, Marc Felix  and
      Zarrie{\ss}, Sina",
    editor = "Basile, Valerio  and
      Bosco, Cristina  and
      Grasso, Francesca  and
      Ibrohim, Muhammad Okky  and
      Skeppstedt, Maria  and
      Stede, Manfred",
    booktitle = "Proceedings of the 1st Workshop on Ecology, Environment, and Natural Language Processing (NLP4Ecology2025)",
    month = mar,
    year = "2025",
    address = "Tallinn, Estonia",
    publisher = "University of Tartu Library",
    url = "https://preview.aclanthology.org/Ingest-2025-COMPUTEL/2025.nlp4ecology-1.20/",
    pages = "94--103",
    ISBN = "978-9908-53-114-4",
    abstract = "This study explores strategies for efficiently classifying scientific full texts using both small, BERT-based models and local large language models like Llama-3.1 8B. We focus on developing methods for selecting subsets of input sentences to reduce input size while simultaneously enhancing classification performance. To this end, we compile a novel dataset consisting of full-text scientific papers from the field of invasion biology, specifically addressing the impacts of invasive species. These papers are aligned with publicly available impact assessments created by researchers for the International Union for Conservation of Nature (IUCN). Through extensive experimentation, we demonstrate that various sources like human evidence annotations, LLM-generated annotations or explainability scores can be used to train sentence selection models that improve the performance of both encoder- and decoder-based language models while optimizing efficiency through the reduction in input length, leading to improved results even if compared to models like ModernBERT that are able to handle the complete text as input. Additionally, we find that repeated sampling of shorter inputs proves to be a very effective strategy that, at a slightly increased cost, can further improve classification performance."
}