Architecture of a Scalable, Secure and Resilient Translation Platform for Multilingual News Media
Susie Coleman, Andrew Secker, Rachel Bawden, Barry Haddow, Alexandra Birch
Abstract
This paper presents an example architecture for a scalable, secure and resilient Machine Translation (MT) platform, using components available via Amazon Web Services (AWS). It is increasingly common for a single news organisation to publish and monitor news sources in multiple languages. A growth in news sources makes this increasingly challenging and time-consuming but MT can help automate some aspects of this process. Building a translation service provides a single integration point for news room tools that use translation technology allowing MT models to be integrated into a system once, rather than each time the translation technology is needed. By using a range of services provided by AWS, it is possible to architect a platform where multiple pre-existing technologies are combined to build a solution, as opposed to developing software from scratch for deployment on a single virtual machine. This increases the speed at which a platform can be developed and allows the use of well-maintained services. However, a single service also provides challenges. It is key to consider how the platform will scale when handling many users and how to ensure the platform is resilient.- Anthology ID:
- 2020.iwltp-1.3
- Volume:
- Proceedings of the 1st International Workshop on Language Technology Platforms
- Month:
- May
- Year:
- 2020
- Address:
- Marseille, France
- Editors:
- Georg Rehm, Kalina Bontcheva, Khalid Choukri, Jan Hajič, Stelios Piperidis, Andrejs Vasiļjevs
- Venue:
- IWLTP
- SIG:
- Publisher:
- European Language Resources Association
- Note:
- Pages:
- 16–21
- Language:
- English
- URL:
- https://aclanthology.org/2020.iwltp-1.3
- DOI:
- Cite (ACL):
- Susie Coleman, Andrew Secker, Rachel Bawden, Barry Haddow, and Alexandra Birch. 2020. Architecture of a Scalable, Secure and Resilient Translation Platform for Multilingual News Media. In Proceedings of the 1st International Workshop on Language Technology Platforms, pages 16–21, Marseille, France. European Language Resources Association.
- Cite (Informal):
- Architecture of a Scalable, Secure and Resilient Translation Platform for Multilingual News Media (Coleman et al., IWLTP 2020)
- PDF:
- https://preview.aclanthology.org/dois-2013-emnlp/2020.iwltp-1.3.pdf