Locating Requests among Open Source Software Communication Messages

Ioannis Korkontzelos, Sophia Ananiadou

Abstract
As a first step towards assessing the quality of support offered online for Open Source Software (OSS), we address the task of locating requests, i.e., messages that raise an issue to be addressed by the OSS community, as opposed to any other message. We present a corpus of online communication messages randomly sampled from newsgroups and bug trackers, manually annotated as requests or non-requests. We identify several linguistically shallow, content-based heuristics that correlate with the classification and investigate the extent to which they can serve as independent classification criteria. Then, we train machine-learning classifiers on these heuristics. We experiment with a wide range of settings, such as different learners, excluding some heuristics and adding unigram features of various parts-of-speech and frequency. We conclude that some heuristics can perform well, while their accuracy can be improved further using machine learning, at the cost of obtaining manual annotations.
Anthology ID:
L14-1413
Volume:
Proceedings of the Ninth International Conference on Language Resources and Evaluation (LREC'14)
Month:
May
Year:
2014
Address:
Reykjavik, Iceland
Editors:
Nicoletta Calzolari, Khalid Choukri, Thierry Declerck, Hrafn Loftsson, Bente Maegaard, Joseph Mariani, Asuncion Moreno, Jan Odijk, Stelios Piperidis
Venue:
LREC
SIG:
Publisher:
European Language Resources Association (ELRA)
Note:
Pages:
1347–1354
Language:
URL:
http://www.lrec-conf.org/proceedings/lrec2014/pdf/498_Paper.pdf
DOI:
Bibkey:
Cite (ACL):
Ioannis Korkontzelos and Sophia Ananiadou. 2014. Locating Requests among Open Source Software Communication Messages. In Proceedings of the Ninth International Conference on Language Resources and Evaluation (LREC'14), pages 1347–1354, Reykjavik, Iceland. European Language Resources Association (ELRA).
Cite (Informal):
Locating Requests among Open Source Software Communication Messages (Korkontzelos & Ananiadou, LREC 2014)
Copy Citation:
PDF:
http://www.lrec-conf.org/proceedings/lrec2014/pdf/498_Paper.pdf
PDF Search