@inproceedings{zheng-etal-2025-tabledreamer,
    title = "{T}able{D}reamer: Progressive and Weakness-guided Data Synthesis from Scratch for Table Instruction Tuning",
    author = "Zheng, Mingyu  and
      Feng, Zhifan  and
      Wang, Jia  and
      Wang, Lanrui  and
      Lin, Zheng  and
      Yang, Hao  and
      Wang, Weiping",
    editor = "Che, Wanxiang  and
      Nabende, Joyce  and
      Shutova, Ekaterina  and
      Pilehvar, Mohammad Taher",
    booktitle = "Findings of the Association for Computational Linguistics: ACL 2025",
    month = jul,
    year = "2025",
    address = "Vienna, Austria",
    publisher = "Association for Computational Linguistics",
    url = "https://preview.aclanthology.org/display_plenaries/2025.findings-acl.381/",
    pages = "7290--7315",
    ISBN = "979-8-89176-256-5",
    abstract = "Despite the commendable progress of recent LLM-based data synthesis methods, they face two limitations in generating table instruction tuning data. First, they can not thoroughly explore the vast input space of table understanding tasks, leading to limited data diversity. Second, they ignore the weaknesses in table understanding ability of the target LLM and blindly pursue the increase of data quantity, resulting in suboptimal data efficiency. In this paper, we introduce a progressive and weakness-guided data synthesis framework tailored for table instruction tuning, named TableDreamer, to mitigate the above issues. Specifically, we first synthesize diverse tables and related instructions as seed data, and then perform an iterative exploration of the input space under the guidance of the newly identified weakness data, which eventually serve as the final training data for fine-tuning the target LLM. Extensive experiments on 10 tabular benchmarks demonstrate the effectiveness of the proposed framework, which boosts the average accuracy of Llama3.1-8B-instruct by 11.62{\%} ($49.07\rightarrow60.69$) with 27K GPT-4o synthetic data and outperforms state-of-the-art data synthesis baselines which use more training data."
}