From Atomic to Complex tasks: Cross-Tasking Improves Zero-Shot Argument Generation and Retrieval

Lynda Tamine, Ahmed Rayane Kebir, Merveille Dona Codjo, Enzo Pasquies, Jose G Moreno


Abstract
Cross-task generalization mimics human intelligence through the ability to perform tasks by recalling foundational skills acquired previously. In this paper, we argue that argument generation and argument retrieval are complex tasks that could leverage cross-tasking atomic argument mining and argument quality assessment tasks, even if there is no supervision. We empirically demonstrate the rationale behind our claim through the ArgLLM framework, including a total of 18.9K instruction data using a multi-choice question-answering format, scaling up through multi-tasking and model merging, six natural language argumentation atomic tasks to four complex argument generation and argument retrieval tasks. Our results and analysis, using the backbone Mistral and Llama models, show that cross-tasking in zero-shot settings outperforms base models and is robust to varying strategies, tasks, and model sizes, offering a valuable trade-off between computational cost and task performance.
Anthology ID:
2026.findings-acl.1246
Volume:
Findings of the Association for Computational Linguistics: ACL 2026
Month:
July
Year:
2026
Address:
San Diego, California, United States
Editors:
Maria Liakata, Viviane P. Moreira, Jiajun Zhang, David Jurgens
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
24864–24882
Language:
URL:
https://preview.aclanthology.org/ingest-acl/2026.findings-acl.1246/
DOI:
Bibkey:
Cite (ACL):
Lynda Tamine, Ahmed Rayane Kebir, Merveille Dona Codjo, Enzo Pasquies, and Jose G Moreno. 2026. From Atomic to Complex tasks: Cross-Tasking Improves Zero-Shot Argument Generation and Retrieval. In Findings of the Association for Computational Linguistics: ACL 2026, pages 24864–24882, San Diego, California, United States. Association for Computational Linguistics.
Cite (Informal):
From Atomic to Complex tasks: Cross-Tasking Improves Zero-Shot Argument Generation and Retrieval (Tamine et al., Findings 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-acl/2026.findings-acl.1246.pdf
Checklist:
 2026.findings-acl.1246.checklist.pdf