@inproceedings{zhang-etal-2026-v,
    title = "{V}-{G}ame{G}ym: Visual Game Generation for Code Large Language Models",
    author = "Zhang, Wei  and
      Yang, Jian  and
      Tao, Renshuai  and
      Chai, Linzheng  and
      Guo, Shuyue  and
      Wu, Jiajun  and
      Chen, Xiaoming  and
      Cui, Ganqu  and
      Ding, Ning  and
      Xu, Xander  and
      Wei, HU  and
      Zhou, Bowen",
    editor = "Liakata, Maria  and
      Moreira, Viviane P.  and
      Zhang, Jiajun  and
      Jurgens, David",
    booktitle = "Findings of the {A}ssociation for {C}omputational {L}inguistics: {ACL} 2026",
    month = jul,
    year = "2026",
    address = "San Diego, California, United States",
    publisher = "Association for Computational Linguistics",
    url = "https://preview.aclanthology.org/ingest-acl/2026.findings-acl.276/",
    pages = "5613--5641",
    ISBN = "979-8-89176-395-1",
    abstract = "Code large language models have demonstrated remarkable capabilities in programming tasks, yet current benchmarks primarily focus on single modality rather than visual game development. Most existing code-related benchmarks evaluate syntax correctness and execution accuracy, overlooking critical game-specific metrics such as playability, visual aesthetics, and user engagement that are essential for real-world deployment. To address the gap between current LLM capabilities in algorithmic problem-solving and competitive programming versus the comprehensive requirements of practical game development, we present V-GameGym, a comprehensive benchmark comprising 2,219 high-quality samples across 100 thematic clusters derived from real-world repositories, adopting a novel clustering-based curation methodology to ensure both diversity and structural completeness. Further, we introduce a multimodal evaluation framework with an automated LLM-driven pipeline for visual code synthesis using complete UI sandbox environments. Our extensive analysis reveals that V-GameGym effectively bridges the gap between code generation accuracy and practical game development workflows, providing quantifiable quality metrics for visual programming and interactive element generation."
}