Siqi Zhang
Other people with similar names: Siqi Zhang
2026
Layer-aware Dual-directional Modulation for Low-resource Machine Translation
Siqi Zhang | Ran Song | Shuting Jiang | Yuxin Huang | Zhengtao Yu
Findings of the Association for Computational Linguistics: ACL 2026
Siqi Zhang | Ran Song | Shuting Jiang | Yuxin Huang | Zhengtao Yu
Findings of the Association for Computational Linguistics: ACL 2026
Although Large Language Models (LLMs) have achieved remarkable success in Machine Translation (MT), a significant performance gap persists between high-resource and low-resource languages due to imbalanced pre-training data. In this paper, we first investigate the internal mechanisms driving this performance disparity from a layer-wise perspective.We propose a metric termed Activation Disparity (𝛥 R) to quantify the activation divergence between high- and low-resource MT. Based on this metric, we distinguish between Task-Adaptive Layers (TAL, 𝛥 R > 0) that encode task-specific signals and Legacy-Inert Layers (LIL, 𝛥 R < 0) dominated by pre-trained bias. Leveraging this finding, we propose the Layer-aware Dual-directional Modulation (LaDM). Integrated with Low-Rank Adaptation (LoRA), LaDM employs a sparse strategy to bidirectionally modulate optimization dynamics. Specifically, it amplifies contributions from TAL to accelerate feature consolidation while inhibiting LIL to dampen misaligned legacy biases. Extensive experiments on Chinese-to-seven low-resource language translation using Llama-3.1, Qwen2.5, and Gemma-2 demonstrate that LaDM significantly outperforms standard LoRA fine-tuning, achieving an average improvement of 1.73 spBLEU.Code is available at https://github.com/zzssqqq/LaDM.
Breaking Consensus Bias: Unsupervised Reinforcement Learning for Machine Translation
Shuting Jiang | Ran Song | Siqi Zhang | Yuxin Huang | Shengxiang Gao | Zhengtao Yu
Findings of the Association for Computational Linguistics: ACL 2026
Shuting Jiang | Ran Song | Siqi Zhang | Yuxin Huang | Shengxiang Gao | Zhengtao Yu
Findings of the Association for Computational Linguistics: ACL 2026
Reinforcement learning (RL) excels in reasoning tasks with verifiable rewards, while its adaptation to machine translation (MT) remains challenging due to the lack of unique reward signals under multiple valid translations. Existing RL approaches for MT face either fixed references in supervised settings or the production of homogeneous references leading to mode collapse in unsupervised settings. Both limitations arise from ignoring entropy dynamics in RL-based MT. The core challenge is leveraging entropy for supervision construction and self-evolution. In this paper, we propose an Entropy-Driven Unsupervised RL for MT. Our framework integrates entropy-guided sampling for exploration, confidence-weighted label generation to transcend majority-voting bias, and uncertainty-aware optimization to prioritize high-entropy tokens. These mechanisms allow reward signals to co-evolve with model proficiency beyond fixed references. Experiments across multiple language pairs show our method outperforms supervised and unsupervised baselines by +0.63 and +2.52 average points, respectively. Our code is available at https://github.com/fortunatekiss/URLMT.