Fourth Message Uunderstanding Conference (MUC-4): Proceedings of a Conference Held in McLean, Virginia, June 16-18, 1992

pdf
Fourth Message Uunderstanding Conference (MUC-4): Proceedings of a Conference Held in McLean, Virginia, June 16-18, 1992

pdf
Overview of the Fourth Message Understanding Evaluation and Conference
Beth M. Sundheim

pdf
MUC-4 Evaluation Metrics
Nancy Chinchor

The Statistical Significance of the MUC-4 Results
Nancy Chinchor

pdf
Text Filtering in B/IUC-3 and MUC-4
David D. Lewis | Richard M. Tong

pdf
An Adjunct Test for Discourse Processing in MUC-4
Lynette Hirschman

pdf
GE Adjunct Test Report: Object-Oriented Design and Scoring for MUC-4
George Krupka | Lisa Rau

pdf
BBN PLUM: MUC-4 Test Results and Analysis
Ralph Weischedel | Damaris Ayuso | Sean Boisen | Heidi Fox | Herbert Gish | Robert Ingria

pdf
GE NLToolset: MUC-4 Test Results and Analysis
Lisa Rau | George Krupka | Paul Jacobs

pdf
TIPSTER SHOGUN System (Joint GE-CMU): MUC-4 Test Results and Analysis
George Krupka | Paul Jacobs | Michael Mauldin | Todd Kaufmann | Ira Sider

pdf
Hughes Research Laboratories Trainable Text Skimmer: MUC-4 Test Results and Analysis
Stephanie E. August | Charles P. Dolan

pdf
Language Systems, Inc.MUC-4 Test Results and Analysis
Christine A. Montgomery | Bonnie Glover Stalls | Robert R. Stumberger | Naicong Li | Robert S. Belvin | Alfredo Arnaiz | Susan B. Hirsh

pdf
McDonnell Douglas Electronic Systems Company MUC-4 Test Results and Analysis
Amnon Meyers | David de Hilster

pdf
MITRE-Bedford ALEMBIC: MUC-4 Test Results and Analysis
John Aberdeen | John Burger | Dennis Connolly | Susan Roberts | Marc Vilain

pdf
CRL/NMSU and Brandeis MucBruce: MUC-4 Test Results and Analysis
Jim Cowie | Louise Guthrie | Yorick Wilks | James Pustejovsky

pdf
New York University PROTEUS System: MUC-4 Test Results and Analysis
Ralph Grishman | John Sterling | Catherine Macleod

pdf
Paramax Systems Corporation: MUC-4 Test Results and Analysis
Carl Weir | Barry Silk

pdf
The PRC PAKTUS System: MUC-4 Test Results and Analysis
Bruce Loatman

pdf
SRA Solomon: MUC-4 Test Results and Analysis
Chinatsu Aone | Doug McKee | Sandy Shinn | Hatte Blejer

pdf
SRI International FASTUS System MUC-4 Test Results and Analysis
Douglas E. Appelt | John Bear | Jerry R. Hobbs | David Israel | Mabry Tyson

pdf
University of Maryland/ConQuest: MUC-4 Test Results and Analysis
James Mayfield

pdf
University of Massachusetts: MUC-4 Test Results and Analysis
W. Lehnert | C. Cardie | D. Fisher | J. McCarthy | E. Riloff | S. Soderland

pdf
The LINK System: MUC-4 Test Results and Analysis
Steven L. Lytinen | Sayan Bhattacharyya | Robert R. Burridge | Peter M. Hastings | Christian Huyck | Karen A. Lipinsky | Eric S. McDaniel | Karenann K. Terrell

pdf
USC: MUC-4 Test Results and Analysis
D. Moldovan | S. Cha | M. Chung | K. Hendrickson | J. Kim | S. Kowalski

pdf
BBN: Description of the PLUM System as Used for MUC-4
Damaris Ayuso | Sean Boisen | Heidi Fox | Herb Gish | Robert Ingria | Ralph Weischedel

pdf
GE NLToolset: Description of the System as Used for MUC-4
George Krupka | Paul Jacobs | Lisa Rau | Lois Childs | Ira Sider

pdf
GE-CMU: Description of the TIPSTER/SHOGUN System as Used for MUC-4
Paul Jacobs | George Krupka | Lisa Rau | Todd Kaufmann | Michael Mauldin

pdf
Hughes Research Laboratories: Description of the Trainable Text Skimmer Used for MUC-4
Stephanie E. August | Charles P. Dolan

pdf
Language Systems, Inc. Description of the DBG System as Used for MUC-4
Christine A. Montgomery | Bonnie Glover Stalls | Robert E. Stumberger | Naicong Li | Robert S. Belvin | Alfredo Arnaiz | Susan B. Hirsh

pdf
McDonnell Douglas Electronic Systems Company: Description of the TexUS System as Used for MUC-4
Amnon Meyers | David de Hilster

pdf
MITRE-Bedford: Description of the ALEMBIC System as Used for MUC-4
John Aberdeen | John Burger | Dennis Connolly | Susan Roberts | Marc Vilain

pdf
CRL/NMSU and Brandeis: Description of the MucBruce System as Used for MUC-4
Jim Cowie | Louise Guthrie | Yorick Wilks

pdf
New York University Description of the PROTEUS System as Used for MUC-4
Ralph Grishman | Catherine Macleod | John Sterling

pdf
Paramax Systems Corporation: Description of the Paramax System Used for MUC-4
Carl Weir | Barry Silk

pdf
PRC Inc: Description of the PAKTUS System Used for MUC-4
Bruce Loatman

pdf
SRA: Description of the Solomon System as Used ForMUC-4
Chinatsu Aone | Doug McKee | Sandy Shinn | Hatte Blejer

pdf
SRI International: Description of the FASTUS System Used for MUC-4
Jerry R. Hobbs | Douglas Appelt | Mabry Tyson | John Bear | David Israel

pdf
University of Maryland/ConQuest: Description of the ICTOAN System as Used for MUC-4
James Mayfield

pdf
University of Massachusetts: Description of the CIRCUS System as Used for MUC-4
W. Lehnert | C. Cardie | D. Fisher | J. McCarthy | E. Riloff | S. Soderland

pdf
Description of the LINK System Used for MUC- 4
Steven L. Lytinen | Sayan Bhattacharyya | Robert R. Burridge | Peter M. Hastings | Christian Huyck | Karen A. Lipinsky | Eric S. McDaniel | Karenann K. Terrell

pdf
USC: Description of the SNAP System Used for MUC-4
D. Moldovan | S. Chet | M. Chung | K. Hendrickson | J. Kim | S. Kowalski

pdf
Part IV: Appendices

pdf
Appendix A: Evaluation Task Description

pdf
Appendix B: Procedure for MUC-4 Final Testing

pdf
Appendix C: Guidelines for Scoring Mismatches Between System Responses and Answer Key

pdf
Appendix D: Sample Texts From TST2 Test Set

pdf
Appendix E: Answer Key Templates for TST2 Sample Texts

pdf
Appendix F: MUC-4 System Walkthrough Example

pdf
Appendix G: Final Test Score Summaries

pdf
Appendix H: Scatter Plots of Final Test Results