Reddit Temporal N-gram Corpus and its Applications on Paraphrase and Semantic Similarity in Social Media using a Topic-based Latent Semantic Analysis
Anh Dang, Abidalrahman Moh’d, Aminul Islam, Rosane Minghim, Michael Smit, Evangelos Milios
Abstract
This paper introduces a new large-scale n-gram corpus that is created specifically from social media text. Two distinguishing characteristics of this corpus are its monthly temporal attribute and that it is created from 1.65 billion comments of user-generated text in Reddit. The usefulness of this corpus is exemplified and evaluated by a novel Topic-based Latent Semantic Analysis (TLSA) algorithm. The experimental results show that unsupervised TLSA outperforms all the state-of-the-art unsupervised and semi-supervised methods in SEMEVAL 2015: paraphrase and semantic similarity in Twitter tasks.- Anthology ID:
- C16-1335
- Volume:
- Proceedings of COLING 2016, the 26th International Conference on Computational Linguistics: Technical Papers
- Month:
- December
- Year:
- 2016
- Address:
- Osaka, Japan
- Editors:
- Yuji Matsumoto, Rashmi Prasad
- Venue:
- COLING
- SIG:
- Publisher:
- The COLING 2016 Organizing Committee
- Note:
- Pages:
- 3553–3564
- Language:
- URL:
- https://aclanthology.org/C16-1335
- DOI:
- Cite (ACL):
- Anh Dang, Abidalrahman Moh’d, Aminul Islam, Rosane Minghim, Michael Smit, and Evangelos Milios. 2016. Reddit Temporal N-gram Corpus and its Applications on Paraphrase and Semantic Similarity in Social Media using a Topic-based Latent Semantic Analysis. In Proceedings of COLING 2016, the 26th International Conference on Computational Linguistics: Technical Papers, pages 3553–3564, Osaka, Japan. The COLING 2016 Organizing Committee.
- Cite (Informal):
- Reddit Temporal N-gram Corpus and its Applications on Paraphrase and Semantic Similarity in Social Media using a Topic-based Latent Semantic Analysis (Dang et al., COLING 2016)
- PDF:
- https://preview.aclanthology.org/naacl24-info/C16-1335.pdf
- Data
- PIT