fairseq: A Fast, Extensible Toolkit for Sequence Modeling
Myle Ott, Sergey Edunov, Alexei Baevski, Angela Fan, Sam Gross, Nathan Ng, David Grangier, Michael Auli
Abstract
fairseq is an open-source sequence modeling toolkit that allows researchers and developers to train custom models for translation, summarization, language modeling, and other text generation tasks. The toolkit is based on PyTorch and supports distributed training across multiple GPUs and machines. We also support fast mixed-precision training and inference on modern GPUs. A demo video can be found at https://www.youtube.com/watch?v=OtgDdWtHvto- Anthology ID:
- N19-4009
- Volume:
- Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics (Demonstrations)
- Month:
- June
- Year:
- 2019
- Address:
- Minneapolis, Minnesota
- Editors:
- Waleed Ammar, Annie Louis, Nasrin Mostafazadeh
- Venue:
- NAACL
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 48–53
- Language:
- URL:
- https://aclanthology.org/N19-4009
- DOI:
- 10.18653/v1/N19-4009
- Cite (ACL):
- Myle Ott, Sergey Edunov, Alexei Baevski, Angela Fan, Sam Gross, Nathan Ng, David Grangier, and Michael Auli. 2019. fairseq: A Fast, Extensible Toolkit for Sequence Modeling. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics (Demonstrations), pages 48–53, Minneapolis, Minnesota. Association for Computational Linguistics.
- Cite (Informal):
- fairseq: A Fast, Extensible Toolkit for Sequence Modeling (Ott et al., NAACL 2019)
- PDF:
- https://preview.aclanthology.org/landing_page/N19-4009.pdf
- Code
- pytorch/fairseq + additional community code
- Data
- CNN/Daily Mail