@inproceedings{du-etal-2025-making,
    title = "Making {LLM}s Better Many-to-Many Speech-to-Text Translators with Curriculum Learning",
    author = "Du, Yexing  and
      Pan, Youcheng  and
      Ma, Ziyang  and
      Yang, Bo  and
      Yang, Yifan  and
      Deng, Keqi  and
      Chen, Xie  and
      Xiang, Yang  and
      Liu, Ming  and
      Qin, Bing",
    editor = "Che, Wanxiang  and
      Nabende, Joyce  and
      Shutova, Ekaterina  and
      Pilehvar, Mohammad Taher",
    booktitle = "Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)",
    month = jul,
    year = "2025",
    address = "Vienna, Austria",
    publisher = "Association for Computational Linguistics",
    url = "https://preview.aclanthology.org/ingestion-acl-25/2025.acl-long.610/",
    pages = "12466--12478",
    ISBN = "979-8-89176-251-0",
    abstract = "Multimodal Large Language Models (MLLMs) have achieved significant success in Speech-to-Text Translation (S2TT) tasks. While most existing research has focused on English-centric translation directions, the exploration of many-to-many translation is still limited by the scarcity of parallel data. To address this, we propose a three-stage curriculum learning strategy that leverages the machine translation capabilities of large language models and adapts them to S2TT tasks, enabling effective learning in low-resource settings. We trained MLLMs with varying parameter sizes (3B, 7B, and 32B) and evaluated the proposed strategy using the FLEURS and CoVoST-2 datasets. Experimental results show that the proposed strategy achieves state-of-the-art average performance in $15\times14$ language pairs, requiring fewer than 10 hours of speech data per language to achieve competitive results. The source code and models are released at \url{https://github.com/yxduir/LLM-SRT}."
}