The Current Landscape of Multimodal Summarization
Atharva Kumbhar, Harsh Kulkarni, Atmaja Mali, Sheetal Sonawane, Prathamesh Mulay
Abstract
In recent years, the rise of multimedia content on the internet has inundated users with a vast and diverse array of information, including images, videos, and textual data. Handling this flood of multimedia data necessitates advanced techniques capable of distilling this wealth of information into concise, meaningful summaries. Multimodal summarization, which involves generating summaries from multiple modalities such as text, images, and videos, has become a pivotal area of research in natural language processing, computer vision, and multimedia analysis. This survey paper offers an overview of the state-of-the-art techniques, methodologies, and challenges in the domain of multimodal summarization. We highlight the interdisciplinary advancements made in this field specifically on the lines of two main frontiers:1) Multimodal Abstractive Summarization, and 2) Pre-training Language Models in Multimodal Summarization. By synthesizing insights from existing research, we aim to provide a holistic understanding of multimodal summarization techniques.- Anthology ID:
- 2023.icon-1.82
- Volume:
- Proceedings of the 20th International Conference on Natural Language Processing (ICON)
- Month:
- December
- Year:
- 2023
- Address:
- Goa University, Goa, India
- Editors:
- Jyoti D. Pawar, Sobha Lalitha Devi
- Venue:
- ICON
- SIG:
- SIGLEX
- Publisher:
- NLP Association of India (NLPAI)
- Note:
- Pages:
- 797–806
- Language:
- URL:
- https://aclanthology.org/2023.icon-1.82
- DOI:
- Cite (ACL):
- Atharva Kumbhar, Harsh Kulkarni, Atmaja Mali, Sheetal Sonawane, and Prathamesh Mulay. 2023. The Current Landscape of Multimodal Summarization. In Proceedings of the 20th International Conference on Natural Language Processing (ICON), pages 797–806, Goa University, Goa, India. NLP Association of India (NLPAI).
- Cite (Informal):
- The Current Landscape of Multimodal Summarization (Kumbhar et al., ICON 2023)
- PDF:
- https://preview.aclanthology.org/fix-dup-bibkey/2023.icon-1.82.pdf