From Atomic to Complex tasks: Cross-Tasking Improves Zero-Shot Argument Generation and Retrieval
Lynda Tamine, Ahmed Rayane Kebir, Merveille Dona Codjo, Enzo Pasquies, Jose G Moreno
Abstract
Cross-task generalization mimics human intelligence through the ability to perform tasks by recalling foundational skills acquired previously. In this paper, we argue that argument generation and argument retrieval are complex tasks that could leverage cross-tasking atomic argument mining and argument quality assessment tasks, even if there is no supervision. We empirically demonstrate the rationale behind our claim through the ArgLLM framework, including a total of 18.9K instruction data using a multi-choice question-answering format, scaling up through multi-tasking and model merging, six natural language argumentation atomic tasks to four complex argument generation and argument retrieval tasks. Our results and analysis, using the backbone Mistral and Llama models, show that cross-tasking in zero-shot settings outperforms base models and is robust to varying strategies, tasks, and model sizes, offering a valuable trade-off between computational cost and task performance.- Anthology ID:
- 2026.findings-acl.1246
- Volume:
- Findings of the Association for Computational Linguistics: ACL 2026
- Month:
- July
- Year:
- 2026
- Address:
- San Diego, California, United States
- Editors:
- Maria Liakata, Viviane P. Moreira, Jiajun Zhang, David Jurgens
- Venue:
- Findings
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 24864–24882
- Language:
- URL:
- https://preview.aclanthology.org/ingest-acl/2026.findings-acl.1246/
- DOI:
- Cite (ACL):
- Lynda Tamine, Ahmed Rayane Kebir, Merveille Dona Codjo, Enzo Pasquies, and Jose G Moreno. 2026. From Atomic to Complex tasks: Cross-Tasking Improves Zero-Shot Argument Generation and Retrieval. In Findings of the Association for Computational Linguistics: ACL 2026, pages 24864–24882, San Diego, California, United States. Association for Computational Linguistics.
- Cite (Informal):
- From Atomic to Complex tasks: Cross-Tasking Improves Zero-Shot Argument Generation and Retrieval (Tamine et al., Findings 2026)
- PDF:
- https://preview.aclanthology.org/ingest-acl/2026.findings-acl.1246.pdf