Abstract
We present a non-autoregressive system submission to the WMT 22 Efficient Translation Shared Task. Our system was used by Helcl et al. (2022) in an attempt to provide fair comparison between non-autoregressive and autoregressive models. This submission is an effort to establish solid baselines along with sound evaluation methodology, particularly in terms of measuring the decoding speed. The model itself is a 12-layer Transformer model trained with connectionist temporal classification on knowledge-distilled dataset by a strong autoregressive teacher model.- Anthology ID:
- 2022.wmt-1.64
- Volume:
- Proceedings of the Seventh Conference on Machine Translation (WMT)
- Month:
- December
- Year:
- 2022
- Address:
- Abu Dhabi, United Arab Emirates (Hybrid)
- Venue:
- WMT
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 668–670
- Language:
- URL:
- https://aclanthology.org/2022.wmt-1.64
- DOI:
- Cite (ACL):
- Jindřich Helcl. 2022. CUNI Non-Autoregressive System for the WMT 22 Efficient Translation Shared Task. In Proceedings of the Seventh Conference on Machine Translation (WMT), pages 668–670, Abu Dhabi, United Arab Emirates (Hybrid). Association for Computational Linguistics.
- Cite (Informal):
- CUNI Non-Autoregressive System for the WMT 22 Efficient Translation Shared Task (Helcl, WMT 2022)
- PDF:
- https://preview.aclanthology.org/author-url/2022.wmt-1.64.pdf