system translation 0.002203038
translation systems 0.001975419
machine translation 0.001929784
translation competition 0.001798857
preference model 0.001782274
ence model 0.001762606
translation sys 0.001728298
translation quality 0.001711479
translation competi 0.001703739
chine translation 0.001702293
test data 0.0017017479999999999
translation spe 0.001700421
translation specialists 0.001700421
model 0.00154043
translation 0.00148084
different translations 0.001434411
other words 0.001372969
test set 0.001342967
different groups 0.001286465
same source 0.001279198
different rankings 0.001271624
tion data 0.001252281
different definitions 0.0012373870000000002
different priorities 0.0012319350000000002
different tracks 0.0012319350000000002
different uses 0.0012319350000000002
different analy 0.0012319350000000002
system ranking 0.001218591
bias data 0.0012068130000000002
data collection 0.001173007
ranking problem 0.00117026
petition data 0.001157436
source sentence 0.0010556670000000002
language pair 0.001053314
same comparisons 0.001049173
source text 0.001034079
actual system 0.001024353
first framework 0.001002193
standardized test 9.84072E-4
heldout test 9.84072E-4
rank system 9.81048E-4
system output 9.77787E-4
same goal 9.633700000000001E-4
bad system 9.596709999999999E-4
fourth system 9.56203E-4
terrific system 9.45457E-4
preferred system 9.42783E-4
probability mass 9.30249E-4
second ranking 8.52785E-4
other hand 8.43253E-4
ical models 8.33802E-4
training preference 8.277480000000001E-4
such elicitation 8.2629E-4
source seg 8.24041E-4
second time 8.07979E-4
preference models 8.0747E-4
good systems 7.852499999999999E-4
right question 7.691320000000001E-4
words 7.58598E-4
ble ranking 7.518550000000001E-4
several years 7.454079999999999E-4
gold ranking 7.35695E-4
ranking heuristics 7.294090000000001E-4
large database 7.29328E-4
system 7.22198E-4
several analyt 7.199839999999999E-4
competition results 7.19541E-4
ranking competi 7.192920000000001E-4
ranking heuristic 7.17622E-4
ranking scheme 7.17622E-4
probability 7.07222E-4
machine transla 7.02155E-4
language 6.98724E-4
joint distribution 6.97759E-4
french sentence 6.89859E-4
empirical comparison 6.86374E-4
problem 6.73867E-4
pairwise comparisons 6.71443E-4
relative ability 6.70743E-4
text interest 6.586890000000001E-4
identical translations 6.5009E-4
respective translations 6.48809E-4
following revision 6.42618E-4
expected values 6.40282E-4
possible segments 6.33057E-4
additional knowledge 6.29749E-4
possible judges 6.2898E-4
wmt competition 6.20701E-4
research groups 6.07184E-4
newswire documents 6.06306E-4
source 5.96307E-4
kit jdoe 5.94929E-4
kit uedin 5.94385E-4
marginal distributions 5.85921E-4
training 5.85904E-4
student pair 5.82688E-4
web forum 5.81682E-4
bilingual speakers 5.80006E-4
competition track 5.77925E-4
universal notion 5.74917E-4
