Abstract
Automated metaphor detection in languages other than English is highly restricted as training corpora are comparably rare. One way to overcome this problem is transfer learning. This paper gives an overview on transfer learning techniques applied to NLP. We first introduce types of transfer learning, then we present work focusing on: i) transfer learning with cross-lingual embeddings; ii) transfer learning in machine translation; and iii) transfer learning using pre-trained transformer models. The paper is complemented by first experiments that make use of bilingual embeddings generated from different sources of parallel data: We i) present the preparation of a parallel Gold corpus; ii) examine the embeddings spaces to search for metaphoric words cross-lingually; iii) run first experiments in transfer learning German metaphor from English labeled data only. Results show that finding data sources for bilingual embeddings training and the vocabulary covered by these embeddings is critical for learning metaphor cross-lingually.- Anthology ID:
- 2022.flp-1.3
- Volume:
- Proceedings of the 3rd Workshop on Figurative Language Processing (FLP)
- Month:
- December
- Year:
- 2022
- Address:
- Abu Dhabi, United Arab Emirates (Hybrid)
- Editors:
- Debanjan Ghosh, Beata Beigman Klebanov, Smaranda Muresan, Anna Feldman, Soujanya Poria, Tuhin Chakrabarty
- Venue:
- Fig-Lang
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 13–23
- Language:
- URL:
- https://aclanthology.org/2022.flp-1.3
- DOI:
- 10.18653/v1/2022.flp-1.3
- Cite (ACL):
- Maria Berger. 2022. Transfer Learning Parallel Metaphor using Bilingual Embeddings. In Proceedings of the 3rd Workshop on Figurative Language Processing (FLP), pages 13–23, Abu Dhabi, United Arab Emirates (Hybrid). Association for Computational Linguistics.
- Cite (Informal):
- Transfer Learning Parallel Metaphor using Bilingual Embeddings (Berger, Fig-Lang 2022)
- PDF:
- https://preview.aclanthology.org/nschneid-patch-4/2022.flp-1.3.pdf