pdf bibAugmenting the kappa statistic to determine interannotator reliability for multiply labeled data pointsAndrew Rosenberg | Ed BinkowskiProceedings of HLT-NAACL 2004: Short Papers