@inproceedings{gude-etal-2026-aligned,
    title = "More Aligned, Less Diverse? Analyzing the Grammar and Lexicon of Two Generations of {LLM}s",
    author = "Gude, Adri{\textbackslash}'an  and
      Santos-Rios, Roi  and
      Bond, Francis  and
      Flickinger, Dan  and
      G{\textbackslash}'omez-Rodr{\{}{\textbackslash}'{\textbackslash}i{\}}guez, Carlos  and
      Zamaraeva, Olga",
    editor = "Liakata, Maria  and
      Moreira, Viviane P.  and
      Zhang, Jiajun  and
      Jurgens, David",
    booktitle = "Proceedings of the 64th Annual Meeting of the {A}ssociation for {C}omputational {L}inguistics (Volume 1: Long Papers)",
    month = jul,
    year = "2026",
    address = "San Diego, California, United States",
    publisher = "Association for Computational Linguistics",
    url = "https://preview.aclanthology.org/ingest-acl/2026.acl-long.1803/",
    pages = "38900--38911",
    ISBN = "979-8-89176-390-6",
    abstract = "This study contributes to a growing line of research in comparing LLM-generated texts with human-authored text, in this case, English news text. We focus in particular on the evaluation of syntactic properties through formal grammar frameworks. Our analysis compares two generations of LLMs in the context of two human-authored English news datasets from two different years. Employing the Head-Driven Phrase Structure Grammar (HPSG) formalism, we investigate the distributions of syntactic structures and lexical types of AI-generated texts and contrast them with the corresponding distributions in the human-authored New Your Times (NYT) articles. We use diversity metrics from ecology and information theory to quantify variation in grammatical constructions and lexical types. Our results show that, while English news text has changed little in the given time frame, newer, instruction-tuned LLMs display reduced syntactic and, especially, lexical diversity compared to older, non-instruction-tuned models. These findings point to future work in studying effects of instruction tuning, which, while enhancing coherence and adherence to prompts, may narrow the expressive range of model output."
}