Markdown (Informal)

[One Teacher is Enough? Pre-trained Language Model Distillation from Multiple Teachers](https://aclanthology.org/2021.findings-acl.387) (Wu et al., Findings 2021)

• One Teacher is Enough? Pre-trained Language Model Distillation from Multiple Teachers (Wu et al., Findings 2021)

ACL

• Chuhan Wu, Fangzhao Wu, and Yongfeng Huang. 2021. One Teacher is Enough? Pre-trained Language Model Distillation from Multiple Teachers. In Findings of the Association for Computational Linguistics: ACL-IJCNLP 2021, pages 4408–4413, Online. Association for Computational Linguistics.