Jian Chen
University at Buffalo
Other people with similar names: Jian Chen
Unverified author pages with similar names: Jian Chen
2026
Can LLMs Estimate Student Struggles? Human-AI Difficulty Alignment with Proficiency Simulation for Item Difficulty Prediction
Ming Li | Han Chen | Yunze Xiao | Jian Chen | Hong Jiao | Tianyi Zhou
Findings of the Association for Computational Linguistics: ACL 2026
Ming Li | Han Chen | Yunze Xiao | Jian Chen | Hong Jiao | Tianyi Zhou
Findings of the Association for Computational Linguistics: ACL 2026
Accurate estimation of item (question or task) difficulty is critical for educational assessment but suffers from the cold start problem. While Large Language Models demonstrate superhuman problem-solving capabilities, it remains an open question whether they can perceive the cognitive struggles of human learners. In this work, we present a large-scale empirical analysis of Human-AI Difficulty Alignment for over 20 models across diverse domains such as medical knowledge and mathematical reasoning. Our findings reveal a systematic misalignment where scaling up model size is not reliably helpful; instead of aligning with humans, models converge toward a shared machine consensus. We observe that high performance often impedes accurate difficulty estimation, as models struggle to simulate the capability limitations of students even when being explicitly prompted to adopt specific proficiency levels. Furthermore, we identify a critical lack of introspection, as models fail to predict their own limitations. These results suggest that general problem-solving capability does not imply an understanding of human cognitive struggles, highlighting the challenge of using current models for automated difficulty prediction.
2025
GUI Agents: A Survey
Dang Nguyen | Jian Chen | Yu Wang | Gang Wu | Namyong Park | Zhengmian Hu | Hanjia Lyu | Junda Wu | Ryan Aponte | Yu Xia | Xintong Li | Jing Shi | Hongjie Chen | Viet Dac Lai | Zhouhang Xie | Sungchul Kim | Ruiyi Zhang | Tong Yu | Mehrab Tanjim | Nesreen K. Ahmed | Puneet Mathur | Seunghyun Yoon | Lina Yao | Branislav Kveton | Jihyung Kil | Thien Huu Nguyen | Trung Bui | Tianyi Zhou | Ryan A. Rossi | Franck Dernoncourt
Findings of the Association for Computational Linguistics: ACL 2025
Dang Nguyen | Jian Chen | Yu Wang | Gang Wu | Namyong Park | Zhengmian Hu | Hanjia Lyu | Junda Wu | Ryan Aponte | Yu Xia | Xintong Li | Jing Shi | Hongjie Chen | Viet Dac Lai | Zhouhang Xie | Sungchul Kim | Ruiyi Zhang | Tong Yu | Mehrab Tanjim | Nesreen K. Ahmed | Puneet Mathur | Seunghyun Yoon | Lina Yao | Branislav Kveton | Jihyung Kil | Thien Huu Nguyen | Trung Bui | Tianyi Zhou | Ryan A. Rossi | Franck Dernoncourt
Findings of the Association for Computational Linguistics: ACL 2025
Graphical User Interface (GUI) agents, powered by Large Foundation Models, have emerged as a transformative approach to automating human-computer interaction. These agents autonomously interact with digital systems via GUIs, emulating human actions such as clicking, typing, and navigating visual elements across diverse platforms. Motivated by the growing interest and fundamental importance of GUI agents, we provide a comprehensive survey that categorizes their benchmarks, evaluation metrics, architectures, and training methods. We propose a unified framework that delineates their perception, reasoning, planning, and acting capabilities. Furthermore, we identify important open challenges and discuss key future directions. Finally, this work serves as a basis for practitioners and researchers to gain an intuitive understanding of current progress, techniques, benchmarks, and critical open problems that remain to be addressed.
2024
TextLap: Customizing Language Models for Text-to-Layout Planning
Jian Chen | Ruiyi Zhang | Yufan Zhou | Jennifer Healey | Jiuxiang Gu | Zhiqiang Xu | Changyou Chen
Findings of the Association for Computational Linguistics: EMNLP 2024
Jian Chen | Ruiyi Zhang | Yufan Zhou | Jennifer Healey | Jiuxiang Gu | Zhiqiang Xu | Changyou Chen
Findings of the Association for Computational Linguistics: EMNLP 2024
Automatic generation of graphical layouts is crucial for many real-world applications, including designing posters, flyers, advertisements, and graphical user interfaces. Given the incredible ability of Large language models (LLMs) in both natural language understanding and generation, we believe that we could customize an LLM to help people create compelling graphical layouts starting with only text instructions from the user. We call our method TextLap (text-based layout planning). It uses a curated instruction-based layout planning dataset (InsLap) to customize LLMs as a graphic designer. Human annotators are asked to build a benchmark to evaluate different layout planning models. We demonstrate the effectiveness of TextLap and show that it outperforms strong baselines, including GPT-4 based methods, for document generation and graphical design benchmarks.
Search
Fix author
Co-authors
- Ruiyi Zhang 2
- Tianyi Zhou 2
- Nesreen K. Ahmed 1
- Ryan Aponte 1
- Trung Bui 1
- Hongjie Chen 1
- Han Chen 1
- Changyou Chen 1
- Franck Dernoncourt 1
- Jiuxiang Gu 1
- Jennifer Healey 1
- Zhengmian Hu 1
- Hong Jiao 1
- Jihyung Kil 1
- Sungchul Kim 1
- Branislav Kveton 1
- Viet Dac Lai 1
- Xintong Li 1
- Ming Li 1
- Hanjia Lyu 1
- Puneet Mathur 1
- Dang Nguyen 1
- Thien Huu Nguyen 1
- Namyong Park 1
- Ryan A. Rossi 1
- Jing Shi 1
- Mehrab Tanjim 1
- Yu Wang 1
- Gang Wu 1
- Junda Wu 1
- Yu Xia 1
- Yunze Xiao 1
- Zhouhang Xie 1
- Lina Yao 1
- Seunghyun Yoon 1
- Tong Yu 1
- Yufan Zhou 1
- Zhiqiang xu 1