Holaaa!! writin like u talk is kewl but kinda hard 4 NLP
Maite Melero, Marta R. Costa-Jussà, Judith Domingo, Montse Marquina, Martí Quixal
Abstract
We present work in progress aiming to build tools for the normalization of User-Generated Content (UGC). As we will see, the task requires the revisiting of the initial steps of NLP processing, since UGC (micro-blog, blog, and, generally, Web 2.0 user texts) presents a number of non-standard communicative and linguistic characteristics, and is in fact much closer to oral and colloquial language than to edited text. We present and characterize a corpus of UGC text in Spanish from three different sources: Twitter, consumer reviews and blogs. We motivate the need for UGC text normalization by analyzing the problems found when processing this type of text through a conventional language processing pipeline, particularly in the tasks of lemmatization and morphosyntactic tagging, and finally we propose a strategy for automatically normalizing UGC using a selector of correct forms on top of a pre-existing spell-checker.- Anthology ID:
- L12-1360
- Volume:
- Proceedings of the Eighth International Conference on Language Resources and Evaluation (LREC'12)
- Month:
- May
- Year:
- 2012
- Address:
- Istanbul, Turkey
- Editors:
- Nicoletta Calzolari, Khalid Choukri, Thierry Declerck, Mehmet Uğur Doğan, Bente Maegaard, Joseph Mariani, Asuncion Moreno, Jan Odijk, Stelios Piperidis
- Venue:
- LREC
- SIG:
- Publisher:
- European Language Resources Association (ELRA)
- Note:
- Pages:
- 3794–3800
- Language:
- URL:
- http://www.lrec-conf.org/proceedings/lrec2012/pdf/627_Paper.pdf
- DOI:
- Cite (ACL):
- Maite Melero, Marta R. Costa-Jussà, Judith Domingo, Montse Marquina, and Martí Quixal. 2012. Holaaa!! writin like u talk is kewl but kinda hard 4 NLP. In Proceedings of the Eighth International Conference on Language Resources and Evaluation (LREC'12), pages 3794–3800, Istanbul, Turkey. European Language Resources Association (ELRA).
- Cite (Informal):
- Holaaa!! writin like u talk is kewl but kinda hard 4 NLP (Melero et al., LREC 2012)
- PDF:
- http://www.lrec-conf.org/proceedings/lrec2012/pdf/627_Paper.pdf