Andrew Rosenberg


2018

pdf
Interpersonal Relationship Labels for the CALLHOME Corpus
Denys Katerenchuk | David Guy Brizan | Andrew Rosenberg
Proceedings of the Eleventh International Conference on Language Resources and Evaluation (LREC 2018)

2016

pdf
RankDCG: Rank-Ordering Evaluation Measure
Denys Katerenchuk | Andrew Rosenberg
Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC'16)

Ranking is used for a wide array of problems, most notably information retrieval (search). Kendall’s τ, Average Precision, and nDCG are a few popular approaches to the evaluation of ranking. When dealing with problems such as user ranking or recommendation systems, all these measures suffer from various problems, including the inability to deal with elements of the same rank, inconsistent and ambiguous lower bound scores, and an inappropriate cost function. We propose a new measure, a modification of the popular nDCG algorithm, named rankDCG, that addresses these problems. We provide a number of criteria for any effective ranking algorithm and show that only rankDCG satisfies them all. Results are presented on constructed and real data sets. We release a publicly available rankDCG evaluation package.

pdf
Identifying Individual Differences in Gender, Ethnicity, and Personality from Dialogue for Deception Detection
Sarah Ita Levitan | Yocheved Levitan | Guozhen An | Michelle Levine | Rivka Levitan | Andrew Rosenberg | Julia Hirschberg
Proceedings of the Second Workshop on Computational Approaches to Deception Detection

2015

pdf
Muddying The Multiword Expression Waters: How Cognitive Demand Affects Multiword Expression Production
Adam Goodkind | Andrew Rosenberg
Proceedings of the 11th Workshop on Multiword Expressions

2010

pdf
Classification of Prosodic Events using Quantized Contour Modeling
Andrew Rosenberg
Human Language Technologies: The 2010 Annual Conference of the North American Chapter of the Association for Computational Linguistics

2009

pdf
Detecting Pitch Accents at the Word, Syllable and Vowel Level
Andrew Rosenberg | Julia Hirschberg
Proceedings of Human Language Technologies: The 2009 Annual Conference of the North American Chapter of the Association for Computational Linguistics, Companion Volume: Short Papers

2007

pdf
V-Measure: A Conditional Entropy-Based External Cluster Evaluation Measure
Andrew Rosenberg | Julia Hirschberg
Proceedings of the 2007 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning (EMNLP-CoNLL)

2006

pdf
Story Segmentation of Broadcast News in English, Mandarin and Arabic
Andrew Rosenberg | Julia Hirschberg
Proceedings of the Human Language Technology Conference of the NAACL, Companion Volume: Short Papers

2004

pdf
Augmenting the kappa statistic to determine interannotator reliability for multiply labeled data points
Andrew Rosenberg | Ed Binkowski
Proceedings of HLT-NAACL 2004: Short Papers