@inproceedings{majer-etal-2026-multi,
    title = "A Multi-Aspect Evaluation Framework for Synthetic Data: Case Study on Irony and Sarcasm",
    author = "Majer, Laura  and
      Bari{\'c}, Ana  and
      Sandalj, Florijan  and
      Unkovi{\'c}, Ivan  and
      Puva{\v{c}}a, Bojan  and
      {\v{S}}najder, Jan",
    editor = "Barnes, Jeremy  and
      Barriere, Valentin  and
      De Clercq, Orph{\'e}e  and
      Klinger, Roman  and
      Nouri, C{\'e}lia  and
      Nozza, Debora  and
      Singh, Pranaydeep",
    booktitle = "The Proceedings for the 15th Workshop on Computational Approaches to Subjectivity, Sentiment Social Media Analysis ({WASSA} 2026)",
    month = mar,
    year = "2026",
    address = "Rabat, Morocco",
    publisher = "Association for Computational Linguistics",
    url = "https://preview.aclanthology.org/ingest-eacl/2026.wassa-1.23/",
    pages = "305--323",
    ISBN = "979-8-89176-378-4",
    abstract = "Data augmentation (DA) using large language models (LLMs) is a cost-effective method for generating synthetic data, particularly for tasks with scarce datasets. However, its potential remains largely underexplored, both in terms of augmentation configuration and evaluation of synthetic data. This paper investigates LLM-based synthetic data generation for irony and sarcasm, two subjective and context-dependent forms of figurative language. We propose a multi-aspect evaluation framework assessing synthetic data{'}s utility-plausibility and extrinsic-intrinsic dimensions through four aspects: predictive performance, sample diversity, linguistic properties, and human judgment. Our findings indicate that other aspects of evaluation, like diversity and linguistic features, do not necessarily correlate with an increase in predictive performance, underscoring the importance of multi-faceted evaluation. This work highlights the potential of LLM-based DA for irony and sarcasm detection, offering insights into the linguistic competence of LLMs. As synthetic data becomes increasingly prevalent, our framework offers a broadly applicable and crucial evaluation method, particularly for linguistically complex tasks."
}