Abstract
We present a probabilistic clustering algorithm that can help Reddit users to find posts that discuss experiences similar to their own. This model is built upon the BERT Next Sentence Prediction model and reduces the time complexity for clustering all posts in a corpus from O(nˆ2) to O(n) with respect to the number of posts. We demonstrate that such probabilistic clustering can yield a performance better than baseline clustering methods based on Latent Dirichlet Allocation (Blei et al., 2003) and Word2Vec (Mikolov et al., 2013). Furthermore, there is a high degree of coherence between our probabilistic clustering and the exhaustive comparison O(nˆ2) algorithm in which the similarity between every pair of posts is found. This makes the use of the BERT Next Sentence Prediction model more practical for unsupervised clustering tasks due to the high runtime overhead of each BERT computation.- Anthology ID:
- D19-5540
- Volume:
- Proceedings of the 5th Workshop on Noisy User-generated Text (W-NUT 2019)
- Month:
- November
- Year:
- 2019
- Address:
- Hong Kong, China
- Editors:
- Wei Xu, Alan Ritter, Tim Baldwin, Afshin Rahimi
- Venue:
- WNUT
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 307–315
- Language:
- URL:
- https://aclanthology.org/D19-5540
- DOI:
- 10.18653/v1/D19-5540
- Cite (ACL):
- Zhilin Wang, Elena Rastorgueva, Weizhe Lin, and Xiaodong Wu. 2019. No, you’re not alone: A better way to find people with similar experiences on Reddit. In Proceedings of the 5th Workshop on Noisy User-generated Text (W-NUT 2019), pages 307–315, Hong Kong, China. Association for Computational Linguistics.
- Cite (Informal):
- No, you’re not alone: A better way to find people with similar experiences on Reddit (Wang et al., WNUT 2019)
- PDF:
- https://preview.aclanthology.org/landing_page/D19-5540.pdf