Divergent Thinking: Escape the Homogeneity Trap in Generative Commonsense Reasoning

Yiheng Tao, Kaiwen Cheng, Zhiwei Nie, Chang Liu, Jie Chen


Abstract
Generative commonsense reasoning (GCR) requires models to synthesize coherent narratives that simultaneously satisfy lexical constraints and commonsense logic. Although ensemble-based LLM strategies are widely adopted to alleviate the fragility of single-chain reasoning, we uncover a counterintuitive homogeneity trap in GCR. Specifically, we observe that increasing the number of reasoning chains can degrade performance, as the generated chains tend to collapse into a narrow semantic region, thereby reinforcing shared biases rather than providing complementary evidence. We posit that escaping this trap requires fundamentally broadening semantic coverage via heterogeneous sources. Our investigation into the nature of diversity reveals that deep semantic diversity, rather than surface-level lexical variation, is the decisive prerequisite for effective integration. Motivated by this insight, we propose an Explore-then-Integrate framework, in which high–semantic-entropy explorers capture diverse concept bindings, and a powerful integrator performs compositional synthesis to merge valid fragments into coherent narratives. Crucially, to ensure that the observed performance gains arise from accurate logical composition rather than trivial best-candidate selection, we introduce a provenance-aware evaluation suite that explicitly quantifies the heterogeneous origins of synthesized outputs. Extensive experiments on multiple benchmarks demonstrate the consistent superiority of our approach across a range of metrics. Notably, our method achieves over 10% improvement in overall accuracy on NoRa and in SPICE score on CommonGen-Lite.
Anthology ID:
2026.findings-acl.915
Volume:
Findings of the Association for Computational Linguistics: ACL 2026
Month:
July
Year:
2026
Address:
San Diego, California, United States
Editors:
Maria Liakata, Viviane P. Moreira, Jiajun Zhang, David Jurgens
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
18395–18410
Language:
URL:
https://preview.aclanthology.org/ingest-acl/2026.findings-acl.915/
DOI:
Bibkey:
Cite (ACL):
Yiheng Tao, Kaiwen Cheng, Zhiwei Nie, Chang Liu, and Jie Chen. 2026. Divergent Thinking: Escape the Homogeneity Trap in Generative Commonsense Reasoning. In Findings of the Association for Computational Linguistics: ACL 2026, pages 18395–18410, San Diego, California, United States. Association for Computational Linguistics.
Cite (Informal):
Divergent Thinking: Escape the Homogeneity Trap in Generative Commonsense Reasoning (Tao et al., Findings 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-acl/2026.findings-acl.915.pdf
Checklist:
 2026.findings-acl.915.checklist.pdf