Generating Harder Cross-document Event Coreference Resolution Datasets using Metaphoric Paraphrasing
Shafiuddin Rehan Ahmed, Zhiyong Wang, George Baker, Kevin Stowe, James Martin
Abstract
The most popular Cross-Document Event Coreference Resolution (CDEC) datasets fail to convey the true difficulty of the task, due to the lack of lexical diversity between coreferring event triggers (words or phrases that refer to an event). Furthermore, there is a dearth of event datasets for figurative language, limiting a crucial avenue of research in event comprehension. We address these two issues by introducing ECB+META, a lexically rich variant of Event Coref Bank Plus (ECB+) for CDEC on symbolic and metaphoric language. We use ChatGPT as a tool for the metaphoric transformation of sentences in the documents of ECB+, then tag the original event triggers in the transformed sentences in a semi-automated manner. In this way, we avoid the re-annotation of expensive coreference links. We present results that show existing methods that work well on ECB+ struggle with ECB+META, thereby paving the way for CDEC research on a much more challenging dataset. Code/data: https://github.com/ahmeshaf/llms_coref- Anthology ID:
- 2024.acl-short.27
- Volume:
- Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers)
- Month:
- August
- Year:
- 2024
- Address:
- Bangkok, Thailand
- Editors:
- Lun-Wei Ku, Andre Martins, Vivek Srikumar
- Venue:
- ACL
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 276–286
- Language:
- URL:
- https://aclanthology.org/2024.acl-short.27
- DOI:
- Cite (ACL):
- Shafiuddin Rehan Ahmed, Zhiyong Wang, George Baker, Kevin Stowe, and James Martin. 2024. Generating Harder Cross-document Event Coreference Resolution Datasets using Metaphoric Paraphrasing. In Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), pages 276–286, Bangkok, Thailand. Association for Computational Linguistics.
- Cite (Informal):
- Generating Harder Cross-document Event Coreference Resolution Datasets using Metaphoric Paraphrasing (Ahmed et al., ACL 2024)
- PDF:
- https://preview.aclanthology.org/ingest-bitext-workshop/2024.acl-short.27.pdf