human evaluation 0.00526425
human summaries 0.00400102
evaluation metrics 0.0039485300000000004
automatic evaluation 0.0038797
summarization evaluation 0.00374258
rouge evaluation 0.003363632
evaluation rouge 0.003363632
evaluation results 0.003236866
ing evaluation 0.0032132750000000002
evaluation method 0.003175614
human evaluations 0.003123732
human sum 0.003118074
human readability 0.0030611
human references 0.0030467190000000002
man evaluation 0.003043638
human evalua 0.003024728
intrinsic evaluation 0.0030010510000000002
human subjects 0.0029973060000000004
evaluation categories 0.002996861
rization evaluation 0.00299496
extrinsic evaluation 0.0029904980000000003
trinsic evaluation 0.0029904980000000003
human evalu 0.00299035
human eval 0.002987753
human annotators 0.002985761
human subject 0.0029850700000000003
human transcriptions 0.0029771520000000003
different summaries 0.00269376
evaluation 0.00263896
human 0.00262529
automatic metrics 0.00255031
summary sentences 0.002434889
automatic summarization 0.00234436
meeting summaries 0.00228177
automatic sentence 0.002192532
summary speech 0.002148214
system summaries 0.002144267
good metric 0.002096209
summary space 0.002080796
rouge score 0.002064992
meeting summarization 0.00200966
accuracy metric 0.001987427
automatic rouge 0.0019654119999999997
summaries original 0.0019294919999999999
average score 0.001928411
summaries speaker 0.001892633
summarization system 0.0018721570000000002
based metric 0.001847171
extractive summaries 0.0018290099999999998
different length 0.001781591
different approaches 0.001780803
man summaries 0.0017804079999999998
tem summaries 0.001772081
meeting data 0.001770269
automatic speech 0.001753274
rouge scores 0.001748292
data set 0.0017356939999999999
different inputs 0.001732299
work automatic 0.001731845
ferent summaries 0.001727433
different meetings 0.001723958
different speakers 0.001715397
ation metrics 0.0017039619999999998
summarization systems 0.0016907290000000002
different annotators 0.001678501
different perspectives 0.001673855
different configurations 0.001673855
text summarization 0.0016621040000000002
automatic summa 0.0016582489999999999
other scores 0.001653556
summarization accuracy 0.0016506770000000001
automatic evalua 0.001640178
summary 0.00163568
information content 0.0016091880000000001
automatic evalu 0.0016058
extractive summarization 0.0015569
duc summarization 0.001519164
summarization techniques 0.001469832
original meeting 0.001459802
metric 0.00144037
low correlation 0.001430401
correlation results 0.001421645
data points 0.001412955
topic points 0.001404386
same words 0.0014003330000000001
speaker information 0.001381144
summaries 0.00137573
test meetings 0.001367502
sentence segmentation 0.001362574
important topic 0.001361986
extractive meeting 0.00135932
score 0.00134032
meeting summa 0.001323549
meeting recordings 0.001314081
meeting domain 0.0013107190000000001
metrics 0.00130957
correlation values 0.001304882
information coverage 0.001303196
entire meeting 0.001302433
similar sentences 0.0012996190000000001
