Employing Glyphic Information for Chinese Event Extraction with Vision-Language Model
Xiaoyi Bao, Jinghang Gu, Zhongqing Wang, Minjie Qiang, Chu-Ren Huang
Abstract
As a complex task that requires rich information input, features from various aspects have been utilized in event extraction. However, most of the previous works ignored the value of glyph, which could contain enriched semantic information and can not be fully expressed by the pre-trained embedding in hieroglyphic languages like Chinese. We argue that, compared with combining the sophisticated textual features, glyphic information from visual modality could provide us with extra and straight semantic information in extracting events. Motivated by this, we propose a glyphic multi-modal Chinese event extraction model with hieroglyphic images to capture the intra- and inter-character morphological structure from the sequence. Extensive experiments build a new state-of-the-art performance in the ACE2005 Chinese and KBP Eval 2017 dataset, which underscores the effectiveness of our proposed glyphic event extraction model, and more importantly, the glyphic feature can be obtained at nearly zero cost.- Anthology ID:
- 2024.findings-emnlp.58
- Volume:
- Findings of the Association for Computational Linguistics: EMNLP 2024
- Month:
- November
- Year:
- 2024
- Address:
- Miami, Florida, USA
- Editors:
- Yaser Al-Onaizan, Mohit Bansal, Yun-Nung Chen
- Venue:
- Findings
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 1068–1080
- Language:
- URL:
- https://aclanthology.org/2024.findings-emnlp.58
- DOI:
- 10.18653/v1/2024.findings-emnlp.58
- Cite (ACL):
- Xiaoyi Bao, Jinghang Gu, Zhongqing Wang, Minjie Qiang, and Chu-Ren Huang. 2024. Employing Glyphic Information for Chinese Event Extraction with Vision-Language Model. In Findings of the Association for Computational Linguistics: EMNLP 2024, pages 1068–1080, Miami, Florida, USA. Association for Computational Linguistics.
- Cite (Informal):
- Employing Glyphic Information for Chinese Event Extraction with Vision-Language Model (Bao et al., Findings 2024)
- PDF:
- https://preview.aclanthology.org/dois-2013-emnlp/2024.findings-emnlp.58.pdf