Insoo Chung
2021
Monotonic Simultaneous Translation with Chunk-wise Reordering and Refinement
HyoJung Han
|
Seokchan Ahn
|
Yoonjung Choi
|
Insoo Chung
|
Sangha Kim
|
Kyunghyun Cho
Proceedings of the Sixth Conference on Machine Translation
Recent work in simultaneous machine translation is often trained with conventional full sentence translation corpora, leading to either excessive latency or necessity to anticipate as-yet-unarrived words, when dealing with a language pair whose word orders significantly differ. This is unlike human simultaneous interpreters who produce largely monotonic translations at the expense of the grammaticality of a sentence being translated. In this paper, we thus propose an algorithm to reorder and refine the target side of a full sentence translation corpus, so that the words/phrases between the source and target sentences are aligned largely monotonically, using word alignment and non-autoregressive neural machine translation. We then train a widely used wait-k simultaneous translation model on this reordered-and-refined corpus. The proposed approach improves BLEU scores and resulting translations exhibit enhanced monotonicity with source sentences.
2020
Extremely Low Bit Transformer Quantization for On-Device Neural Machine Translation
Insoo Chung
|
Byeongwook Kim
|
Yoonjung Choi
|
Se Jung Kwon
|
Yongkweon Jeon
|
Baeseong Park
|
Sangha Kim
|
Dongsoo Lee
Findings of the Association for Computational Linguistics: EMNLP 2020
The deployment of widely used Transformer architecture is challenging because of heavy computation load and memory overhead during inference, especially when the target device is limited in computational resources such as mobile or edge devices. Quantization is an effective technique to address such challenges. Our analysis shows that for a given number of quantization bits, each block of Transformer contributes to translation quality and inference computations in different manners. Moreover, even inside an embedding block, each word presents vastly different contributions. Correspondingly, we propose a mixed precision quantization strategy to represent Transformer weights by an extremely low number of bits (e.g., under 3 bits). For example, for each word in an embedding block, we assign different quantization bits based on statistical property. Our quantized Transformer model achieves 11.8× smaller model size than the baseline model, with less than -0.5 BLEU. We achieve 8.3× reduction in run-time memory footprints and 3.5× speed up (Galaxy N10+) such that our proposed compression strategy enables efficient implementation for on-device NMT.
2019
Look Harder: A Neural Machine Translation Model with Hard Attention
Sathish Reddy Indurthi
|
Insoo Chung
|
Sangha Kim
Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics
Soft-attention based Neural Machine Translation (NMT) models have achieved promising results on several translation tasks. These models attend all the words in the source sequence for each target token, which makes them ineffective for long sequence translation. In this work, we propose a hard-attention based NMT model which selects a subset of source tokens for each target token to effectively handle long sequence translation. Due to the discrete nature of the hard-attention mechanism, we design a reinforcement learning algorithm coupled with reward shaping strategy to efficiently train it. Experimental results show that the proposed model performs better on long sequences and thereby achieves significant BLEU score improvement on English-German (EN-DE) and English-French (ENFR) translation tasks compared to the soft attention based NMT.
Search
Co-authors
- Sangha Kim 3
- Yoonjung Choi 2
- Byeongwook Kim 1
- Se Jung Kwon 1
- Yongkweon Jeon 1
- show all...