Merely Judging Metaphor is Not Enough: Research on Reasonable Metaphor Detection

Puli Chen, Cheng Yang, Qingbao Huang

Abstract
Metaphor, as an advanced form of cognition, is challenging to understand their meaning. Current metaphor detection tasks only provide labels (i.e., metaphor or literal) without interpreting how to understand them. In this paper, we improve the metaphor detection task and explore the reason of metaphor. To the best of our knowledge, we are the first work to reason about metaphor using mainstream Large Language Models (LLMs). Specifically, we utilized ChatGPT3.5 to expand the mainstream datasets in current metaphor detection, including VUA ALL, TroFi, and MOH-X. We input the original sentence, target word, and usage (metaphor or literal) into ChatGPT, guiding it to generate corresponding metaphor reason. Then, we designed supervised baseline experiments (e.g., RoBERTa, GPT-2) and zero-shot experiments with LLMs (e.g., LLaMA3). For the results generated by the above experiments, we provided the case study. We devised four methods that include manual evaluation to evaluate the reason performance of the model, and discussed extensively the advantages and disadvantages of these evaluation methods. Our code is available at https://github.com/yc-cy/Metaphorical-Reasoning.
Anthology ID:
2024.findings-emnlp.336
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2024
Month:
November
Year:
2024
Address:
Miami, Florida, USA
Editors:
Yaser Al-Onaizan, Mohit Bansal, Yun-Nung Chen
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
5850–5860
Language:
URL:
https://preview.aclanthology.org/add_missing_videos/2024.findings-emnlp.336/
DOI:
10.18653/v1/2024.findings-emnlp.336
Bibkey:
Cite (ACL):
Puli Chen, Cheng Yang, and Qingbao Huang. 2024. Merely Judging Metaphor is Not Enough: Research on Reasonable Metaphor Detection. In Findings of the Association for Computational Linguistics: EMNLP 2024, pages 5850–5860, Miami, Florida, USA. Association for Computational Linguistics.
Cite (Informal):
Merely Judging Metaphor is Not Enough: Research on Reasonable Metaphor Detection (Chen et al., Findings 2024)
Copy Citation:
PDF:
https://preview.aclanthology.org/add_missing_videos/2024.findings-emnlp.336.pdf
PDF Search Fix data