Cluster-Former: Clustering-based Sparse Transformer for Question Answering
Shuohang Wang, Luowei Zhou, Zhe Gan, Yen-Chun Chen, Yuwei Fang, Siqi Sun, Yu Cheng, Jingjing Liu
- Anthology ID:
- 2021.findings-acl.346
- Volume:
- Findings of the Association for Computational Linguistics: ACL-IJCNLP 2021
- Month:
- August
- Year:
- 2021
- Address:
- Online
- Editors:
- Chengqing Zong, Fei Xia, Wenjie Li, Roberto Navigli
- Venue:
- Findings
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 3958–3968
- Language:
- URL:
- https://aclanthology.org/2021.findings-acl.346
- DOI:
- 10.18653/v1/2021.findings-acl.346
- Cite (ACL):
- Shuohang Wang, Luowei Zhou, Zhe Gan, Yen-Chun Chen, Yuwei Fang, Siqi Sun, Yu Cheng, and Jingjing Liu. 2021. Cluster-Former: Clustering-based Sparse Transformer for Question Answering. In Findings of the Association for Computational Linguistics: ACL-IJCNLP 2021, pages 3958–3968, Online. Association for Computational Linguistics.
- Cite (Informal):
- Cluster-Former: Clustering-based Sparse Transformer for Question Answering (Wang et al., Findings 2021)
- PDF:
- https://preview.aclanthology.org/proper-vol2-ingestion/2021.findings-acl.346.pdf
- Data
- Natural Questions, QUASAR, QUASAR-T, SearchQA, WikiText-103, WikiText-2