Matteo Brucato
2021
SUBSUME: A Dataset for Subjective Summary Extraction from Wikipedia Documents
Nishant Yadav
|
Matteo Brucato
|
Anna Fariha
|
Oscar Youngquist
|
Julian Killingback
|
Alexandra Meliou
|
Peter Haas
Proceedings of the Third Workshop on New Frontiers in Summarization
Many applications require generation of summaries tailored to the user’s information needs, i.e., their intent. Methods that express intent via explicit user queries fall short when query interpretation is subjective. Several datasets exist for summarization with objective intents where, for each document and intent (e.g., “weather”), a single summary suffices for all users. No datasets exist, however, for subjective intents (e.g., “interesting places”) where different users will provide different summaries. We present SUBSUME, the first dataset for evaluation of SUBjective SUMmary Extraction systems. SUBSUME contains 2,200 (document, intent, summary) triplets over 48 Wikipedia pages, with ten intents of varying subjectivity, provided by 103 individuals over Mechanical Turk. We demonstrate statistically that the intents in SUBSUME vary systematically in subjectivity. To indicate SUBSUME’s usefulness, we explore a collection of baseline algorithms for subjective extractive summarization and show that (i) as expected, example-based approaches better capture subjective intents than query-based ones, and (ii) there is ample scope for improving upon the baseline algorithms, thereby motivating further research on this challenging problem.
2013
Recognising and Interpreting Named Temporal Expressions
Matteo Brucato
|
Leon Derczynski
|
Hector Llorens
|
Kalina Bontcheva
|
Christian S. Jensen
Proceedings of the International Conference Recent Advances in Natural Language Processing RANLP 2013
Search
Co-authors
- Leon Derczynski 1
- Héctor Llorens 1
- Kalina Bontcheva 1
- Christian S. Jensen 1
- Nishant Yadav 1
- show all...