Automatic Video Dubbing at AppTek
Mattia Di Gangi, Nick Rossenbach, Alejandro Pérez, Parnia Bahar, Eugen Beck, Patrick Wilken, Evgeny Matusov
Abstract
Video dubbing is the activity of revoicing a video while offering a viewing experience equivalent to the original video. The revoicing usually comes with a changed script, mostly in a different language, and the revoicing should reproduce the original emotions, coherent with the body language, and lip synchronized. In this project, we aim to build an AD system in three phases: (1) voice-over; (2) emotional voice-over; (3) full dubbing, while enhancing the system with human-in-the-loop capabilities for a higher quality.- Anthology ID:
- 2022.eamt-1.65
- Volume:
- Proceedings of the 23rd Annual Conference of the European Association for Machine Translation
- Month:
- June
- Year:
- 2022
- Address:
- Ghent, Belgium
- Venue:
- EAMT
- SIG:
- Publisher:
- European Association for Machine Translation
- Note:
- Pages:
- 351–352
- Language:
- URL:
- https://aclanthology.org/2022.eamt-1.65
- DOI:
- Cite (ACL):
- Mattia Di Gangi, Nick Rossenbach, Alejandro Pérez, Parnia Bahar, Eugen Beck, Patrick Wilken, and Evgeny Matusov. 2022. Automatic Video Dubbing at AppTek. In Proceedings of the 23rd Annual Conference of the European Association for Machine Translation, pages 351–352, Ghent, Belgium. European Association for Machine Translation.
- Cite (Informal):
- Automatic Video Dubbing at AppTek (Di Gangi et al., EAMT 2022)
- PDF:
- https://preview.aclanthology.org/ingestion-script-update/2022.eamt-1.65.pdf