Matthew W. Bilotti

Also published as: Matthew Bilotti


2008

pdf bib
Improving Text Retrieval Precision and Answer Accuracy in Question Answering Systems
Matthew Bilotti | Eric Nyberg
Coling 2008: Proceedings of the 2nd workshop on Information Retrieval for Question Answering

2006

pdf bib
Evaluation for Scenario Question Answering Systems
Matthew W. Bilotti | Eric Nyberg
Proceedings of the Fifth International Conference on Language Resources and Evaluation (LREC’06)

Scenario Question Answering is a relatively new direction in Question Answering (QA) research that presents a number of challenges for evaluation. In this paper, we propose a comprehensive evaluation strategy for Scenario QA, including amethodology for building reusable test collections for Scenario QA and metrics for evaluating system performance over such test collections. Using this methodology, we have built a test collection, which we have made available for public download as a service to the research community. It is our hope that widespread availability of quality evaluation materials fuels research in new approaches to the Scenario QA task.
Search
Co-authors
Venues