Irregularity Detection in Categorized Document Corpora

Borut Sluban, Senja Pollak, Roel Coesemans, Nada Lavrač


Abstract
The paper presents an approach to extract irregularities in document corpora, where the documents originate from different sources and the analyst's interest is to find documents which are atypical for the given source. The main contribution of the paper is a voting-based approach to irregularity detection and its evaluation on a collection of newspaper articles from two sources: Western (UK and US) and local (Kenyan) media. The evaluation of a domain expert proves that the method is very effective in uncovering interesting irregularities in categorized document corpora.
Anthology ID:
L12-1409
Volume:
Proceedings of the Eighth International Conference on Language Resources and Evaluation (LREC'12)
Month:
May
Year:
2012
Address:
Istanbul, Turkey
Editors:
Nicoletta Calzolari, Khalid Choukri, Thierry Declerck, Mehmet Uğur Doğan, Bente Maegaard, Joseph Mariani, Asuncion Moreno, Jan Odijk, Stelios Piperidis
Venue:
LREC
SIG:
Publisher:
European Language Resources Association (ELRA)
Note:
Pages:
1598–1603
Language:
URL:
http://www.lrec-conf.org/proceedings/lrec2012/pdf/706_Paper.pdf
DOI:
Bibkey:
Cite (ACL):
Borut Sluban, Senja Pollak, Roel Coesemans, and Nada Lavrač. 2012. Irregularity Detection in Categorized Document Corpora. In Proceedings of the Eighth International Conference on Language Resources and Evaluation (LREC'12), pages 1598–1603, Istanbul, Turkey. European Language Resources Association (ELRA).
Cite (Informal):
Irregularity Detection in Categorized Document Corpora (Sluban et al., LREC 2012)
Copy Citation:
PDF:
http://www.lrec-conf.org/proceedings/lrec2012/pdf/706_Paper.pdf