human evaluation 0.0030136
summary evaluation 0.00284593
automatic evaluation 0.00257005
automatic summary 0.0023179999999999997
automatic summarization 0.00224308
evaluation metrics 0.0022102370000000003
manual evaluation 0.002090259
different systems 0.002035972
automatic scores 0.001969425
human reference 0.0019679420000000003
reference summaries 0.001944442
evaluation approaches 0.001906338
document summarization 0.0018852250000000001
human judgements 0.0017809660000000001
erence summaries 0.001759935
informative summary 0.0017409769999999999
news summary 0.001732747
initial summary 0.0017195799999999998
automatic content 0.001698609
summarization sys 0.001557538
evaluation 0.00154899
manual metric 0.001526042
different variants 0.001488269
document sets 0.001468209
summaries 0.00144111
automatic evaluations 0.001433721
small set 0.001390278
good systems 0.001386624
information need 0.001374233
subsequent set 0.0013434599999999999
content metrics 0.001338796
automatic eval 0.0013362040000000001
pyramid score 0.001327031
tion scores 0.001306011
summary 0.00129694
test inputs 0.001280464
summarization 0.00122202
pating systems 0.001197059
other years 0.001178718
syntactic dependencies 0.0011609049999999998
topic statement 0.001146973
test statistic 0.001136241
respective test 0.001129171
individual document 0.00109716
other hand 0.001095577
content selection 0.00108055
analysis conference 0.001076384
content unit 0.001073346
content units 0.0010697389999999999
system 0.00102625
manual pyramid 0.001020873
several rouge 9.96112E-4
metric 9.84773E-4
syntactic relations 9.76764E-4
significant differences 9.7635E-4
computing correlation 9.57641E-4
information 9.49953E-4
scores 9.48365E-4
rouge variants 9.18758E-4
several reference 9.16495E-4
many evalua 9.13069E-4
important aspects 8.996259999999999E-4
systems 8.83512E-4
available reference 8.716609999999999E-4
overall responsiveness 8.664219999999999E-4
selection performance 8.51698E-4
particular focus 8.50595E-4
score 8.47427E-4
detailed answer 8.33926E-4
natural dis 8.30392E-4
statistical significance 8.249069999999999E-4
good grasp 8.23417E-4
responsiveness evalu 8.212289999999999E-4
specific wording 8.20904E-4
common sub 8.20147E-4
pairwise comparisons 8.19698E-4
similar instructions 8.10161E-4
input 8.08052E-4
mid method 8.00736E-4
topic 7.72223E-4
cant differences 7.67752E-4
mation need 7.63805E-4
ent researchers 7.62797E-4
statistical tests 7.59217E-4
tomatic evaluations 7.563229999999999E-4
tomatic prediction 7.5556E-4
reasonable substitute 7.52887E-4
formation need 7.4899E-4
year pyr 7.29329E-4
weighted version 7.25996E-4
finding sig 7.10058E-4
predefined domains 7.09276E-4
brief statement 7.07837E-4
content 6.77549E-4
analysis 6.74233E-4
average 6.66434E-4
document 6.63205E-4
metrics 6.61247E-4
documents 6.41639E-4
correlation 6.4159E-4
