Abstract
The paper steps outside the comfort-zone of the traditional NLP tasks like automatic speech recognition (ASR) and machine translation (MT) to addresses two novel problems arising in the automated multilingual news monitoring: segmentation of the TV and radio program ASR transcripts into individual stories, and clustering of the individual stories coming from various sources and languages into storylines. Storyline clustering of stories covering the same events is an essential task for inquisitorial media monitoring. We address these two problems jointly by engaging the low-dimensional semantic representation capabilities of the sequence to sequence neural translation models. To enable joint multi-task learning for multilingual neural translation of morphologically rich languages we replace the attention mechanism with the sliding-window mechanism and operate the sequence to sequence neural translation model on the character-level rather than on the word-level. The story segmentation and storyline clustering problem is tackled by examining the low-dimensional vectors produced as a side-product of the neural translation process. The results of this paper describe a novel approach to the automatic story segmentation and storyline clustering problem.- Anthology ID:
- L16-1282
- Volume:
- Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC'16)
- Month:
- May
- Year:
- 2016
- Address:
- Portorož, Slovenia
- Venue:
- LREC
- SIG:
- Publisher:
- European Language Resources Association (ELRA)
- Note:
- Pages:
- 1789–1793
- Language:
- URL:
- https://aclanthology.org/L16-1282
- DOI:
- Cite (ACL):
- Guntis Barzdins, Steve Renals, and Didzis Gosko. 2016. Character-Level Neural Translation for Multilingual Media Monitoring in the SUMMA Project. In Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC'16), pages 1789–1793, Portorož, Slovenia. European Language Resources Association (ELRA).
- Cite (Informal):
- Character-Level Neural Translation for Multilingual Media Monitoring in the SUMMA Project (Barzdins et al., LREC 2016)
- PDF:
- https://preview.aclanthology.org/ingestion-script-update/L16-1282.pdf
- Code
- didzis/tensorflowAMR