CURIE: An Iterative Querying Approach for Reasoning About Situations
Dheeraj Rajagopal, Aman Madaan, Niket Tandon, Yiming Yang, Shrimai Prabhumoye, Abhilasha Ravichander, Peter Clark, Eduard H Hovy
Abstract
Predicting the effects of unexpected situations is an important reasoning task, e.g., would cloudy skies help or hinder plant growth? Given a context, the goal of such situational reasoning is to elicit the consequences of a new situation (st) that arises in that context. We propose CURIE, a method to iteratively build a graph of relevant consequences explicitly in a structured situational graph (st graph) using natural language queries over a finetuned language model. Across multiple domains, CURIE generates st graphs that humans find relevant and meaningful in eliciting the consequences of a new situation (75% of the graphs were judged correct by humans). We present a case study of a situation reasoning end task (WIQA-QA), where simply augmenting their input with st graphs improves accuracy by 3 points. We show that these improvements mainly come from a hard subset of the data, that requires background knowledge and multi-hop reasoning.- Anthology ID:
- 2022.csrr-1.7
- Volume:
- Proceedings of the First Workshop on Commonsense Representation and Reasoning (CSRR 2022)
- Month:
- May
- Year:
- 2022
- Address:
- Dublin, Ireland
- Editors:
- Antoine Bosselut, Xiang Li, Bill Yuchen Lin, Vered Shwartz, Bodhisattwa Prasad Majumder, Yash Kumar Lal, Rachel Rudinger, Xiang Ren, Niket Tandon, Vilém Zouhar
- Venue:
- CSRR
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 49–63
- Language:
- URL:
- https://aclanthology.org/2022.csrr-1.7
- DOI:
- 10.18653/v1/2022.csrr-1.7
- Cite (ACL):
- Dheeraj Rajagopal, Aman Madaan, Niket Tandon, Yiming Yang, Shrimai Prabhumoye, Abhilasha Ravichander, Peter Clark, and Eduard H Hovy. 2022. CURIE: An Iterative Querying Approach for Reasoning About Situations. In Proceedings of the First Workshop on Commonsense Representation and Reasoning (CSRR 2022), pages 49–63, Dublin, Ireland. Association for Computational Linguistics.
- Cite (Informal):
- CURIE: An Iterative Querying Approach for Reasoning About Situations (Rajagopal et al., CSRR 2022)
- PDF:
- https://preview.aclanthology.org/nschneid-patch-3/2022.csrr-1.7.pdf
- Data
- QuaRTz, QuaRel, WIQA