A Secure and Efficient Federated Learning Framework for NLP
Chenghong Wang, Jieren Deng, Xianrui Meng, Yijue Wang, Ji Li, Sheng Lin, Shuo Han, Fei Miao, Sanguthevar Rajasekaran, Caiwen Ding
Abstract
In this work, we consider the problem of designing secure and efficient federated learning (FL) frameworks for NLP. Existing solutions under this literature either consider a trusted aggregator or require heavy-weight cryptographic primitives, which makes the performance significantly degraded. Moreover, many existing secure FL designs work only under the restrictive assumption that none of the clients can be dropped out from the training protocol. To tackle these problems, we propose SEFL, a secure and efficient federated learning framework that (1) eliminates the need for the trusted entities; (2) achieves similar and even better model accuracy compared with existing FL designs; (3) is resilient to client dropouts.- Anthology ID:
- 2021.emnlp-main.606
- Volume:
- Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing
- Month:
- November
- Year:
- 2021
- Address:
- Online and Punta Cana, Dominican Republic
- Editors:
- Marie-Francine Moens, Xuanjing Huang, Lucia Specia, Scott Wen-tau Yih
- Venue:
- EMNLP
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 7676–7682
- Language:
- URL:
- https://aclanthology.org/2021.emnlp-main.606
- DOI:
- 10.18653/v1/2021.emnlp-main.606
- Cite (ACL):
- Chenghong Wang, Jieren Deng, Xianrui Meng, Yijue Wang, Ji Li, Sheng Lin, Shuo Han, Fei Miao, Sanguthevar Rajasekaran, and Caiwen Ding. 2021. A Secure and Efficient Federated Learning Framework for NLP. In Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, pages 7676–7682, Online and Punta Cana, Dominican Republic. Association for Computational Linguistics.
- Cite (Informal):
- A Secure and Efficient Federated Learning Framework for NLP (Wang et al., EMNLP 2021)
- PDF:
- https://preview.aclanthology.org/add_acl24_videos/2021.emnlp-main.606.pdf