other questions 0.002103177
other question 0.001987357
many questions 0.001831855
factoid questions 0.001816266
individual questions 0.001768309
questions complex 0.001764889
complex questions 0.001764889
answer string 0.0017380520000000001
system training 0.0017268919999999998
answer key 0.001724927
list questions 0.0016919130000000002
ual questions 0.00166657
inition questions 0.001656705
individual question 0.001652489
question series 0.001650414
complex question 0.001649069
answer strings 0.001625934
answer will 0.0016130320000000001
question answering 0.001603911
nlp system 0.001599185
system components 0.001594573
question level 0.001573826
sample question 0.00156982
different pairs 0.001555072
system output 0.0015434749999999999
system response 0.0015144989999999999
nugget evaluation 0.0015087030000000001
system runs 0.001501315
system developers 0.001497596
system comparisons 0.0014975589999999999
system responses 0.001496774
information nuggets 0.001493814
information retrieval 0.00149013
different sets 0.001478462
different assessors 0.0014535440000000002
different methods 0.0014386820000000002
questions 0.001425
different assumptions 0.001405871
different approaches 0.0013960230000000001
answer 0.00138096
such systems 0.0013692840000000001
different times 0.001367542
different issues 0.001365382
different assump 0.0013447860000000002
different numbers 0.0013447860000000002
different granularities 0.0013447860000000002
different facets 0.0013447860000000002
question 0.00130918
information content 0.001307787
evaluation results 0.00130474
complex information 0.00128002
relevant information 0.001269129
system 0.00126316
information needs 0.001241186
binary score 0.001223797
evaluation setup 0.001210224
evaluation stability 0.001193366
evaluation methodology 0.001188119
such complex 0.0011811220000000002
information need 0.001176975
evaluation conditions 0.001174212
subsequent evaluation 0.001166136
evaluation processes 0.001164379
evaluation methodologies 0.001154279
same results 0.001147849
evaluation methodol 0.001147777
evaluation steps 0.001146829
pyramid nugget 0.001141454
nugget pyramid 0.001141454
human language 0.001140864
same assessor 0.0011191600000000001
final score 0.001106271
nugget performance 0.001091376
such thatx 0.001074926
pyramid scores 0.001067338
score distribution 0.001058426
other relations 0.001051863
particular nugget 0.001036805
other nlp 0.001014202
human users 9.91935E-4
document retrieval 9.89786E-4
text classification 9.86871E-4
human annotation 9.79543E-4
multiple nuggets 9.705580000000001E-4
pyramid method 9.69566E-4
human opinions 9.69564E-4
average pyramid 9.49968E-4
information 9.40131E-4
median score 9.38661E-4
nugget precision 9.38452E-4
human labor 9.303E-4
human idiosyncrasies 9.303E-4
trec evaluations 9.30194E-4
current nugget 9.28351E-4
previous trec 9.21603E-4
other hand 9.17283E-4
variance model 9.164440000000001E-4
evaluation 9.14801E-4
individual nuggets 8.96992E-4
nugget match 8.958799999999999E-4
