evaluation metric 0.0030164700000000003
automatic evaluation 0.002382968
system evaluation 0.00231186
human model 0.00224918
human summaries 0.0022453100000000004
similarity metric 0.002233157
metric set 0.0021956470000000002
different summaries 0.00213656
model summaries 0.00212047
single evaluation 0.002118117
sets evaluation 0.002018028
qarla evaluation 0.002012098
evaluation framework 0.00200027
single metric 0.001950327
evaluation criterion 0.001929032
model summary 0.001927183
evaluation mea 0.001916464
comparative evaluation 0.001912276
different metrics 0.001906071
different test 0.001890775
evaluation exercise 0.0018866619999999999
parative evaluation 0.0018866619999999999
different models 0.001885789
evaluation purposes 0.001881442
evaluation outcome 0.001864568
stable evaluation 0.001864568
evaluation guidelines 0.001864568
metric sets 0.0018502380000000001
automatic summaries 0.0018491380000000002
individual metric 0.00184255
model set 0.001833477
similarity measure 0.0018242269999999999
metric combination 0.001818521
metric weighting 0.001764032
metric space 0.001755178
ity metric 0.001710354
metric combinations 0.0017060080000000002
ation metric 0.001703541
ideal metric 0.001703487
ual metric 0.0017002220000000001
best metric 0.001699323
larity metric 0.0016989540000000001
metric normalisation 0.0016970400000000001
vidual metric 0.0016970400000000001
metric inx 0.0016970400000000001
metric counterpart 0.0016970400000000001
manual summaries 0.0016888850000000002
different features 0.001659931
automatic summary 0.0016558509999999999
different quality 0.00163758
similarity metrics 0.001636628
summaries quality 0.0016176200000000002
evaluation 0.00159213
test set 0.001583822
human performance 0.001575084
quality measure 0.0015747299999999999
different baseline 0.001514334
manual summary 0.001495598
baseline summaries 0.0014943740000000001
human assessors 0.001491306
human assessments 0.001481642
different algorithms 0.001466439
information synthesis 0.001466197
human summarisers 0.001465883
human summariser 0.001464732
human subjects 0.001463593
information retrieval 0.001461644
human summarising 0.001459541
new model 0.0014548360000000001
rouge measure 0.001454007
qarla measure 0.001435378
relative word 0.001425843
metric 0.00142434
several metrics 0.0014213160000000002
standard summaries 0.001420924
extractive summaries 0.0014119050000000002
queen measure 0.0014027760000000001
third model 0.001390638
metrics quality 0.001387131
different aspects 0.001379377
standard measure 0.001378034
automatic summarization 0.001364189
different conclusions 0.00135637
probabilistic measure 0.00135552
different users 0.00135545
different classes 0.0013543119999999999
tomatic summaries 0.001348405
summaries inm 0.001332648
jack measure 0.001331803
qualitative information 0.001322094
king measure 0.001313857
retrieval test 0.001310999
unigram measure 0.001308747
reference summary 0.001306822
large set 0.001292377
other words 0.0012620840000000001
metrics figure 0.001247372
good results 0.0012463180000000002
individual metrics 0.001246021
similarity values 0.001237961
