Roger Evans

Also published as: R Evans


2017

pdf
A Calibration Method for Evaluation of Sentiment Analysis
F. Sharmila Satthar | Roger Evans | Gulden Uchyigit
Proceedings of the International Conference Recent Advances in Natural Language Processing, RANLP 2017

Sentiment analysis is the computational task of extracting sentiment from a text document – for example whether it expresses a positive, negative or neutral opinion. Various approaches have been introduced in recent years, using a range of different techniques to extract sentiment information from a document. Measuring these methods against a gold standard dataset is a useful way to evaluate such systems. However, different sentiment analysis techniques represent sentiment values in different ways, such as discrete categorical classes or continuous numerical sentiment scores. This creates a challenge for evaluating and comparing such systems; in particular assessing numerical scores against datasets that use fixed classes is difficult, because the numerical outputs have to be mapped onto the ordered classes. This paper proposes a novel calibration technique that uses precision vs. recall curves to set class thresholds to optimize a continuous sentiment analyser’s performance against a discrete gold standard dataset. In experiments mapping a continuous score onto a three-class classification of movie reviews, we show that calibration results in a substantial increase in f-score when compared to a non-calibrated mapping.

2015

pdf
Obituaries: Adam Kilgarriff
Roger Evans
Computational Linguistics, Volume 41, Issue 4 - December 2015

2013

pdf
The Extended Lexicon: Language Processing as Lexical Description
Roger Evans
Proceedings of the International Conference Recent Advances in Natural Language Processing RANLP 2013

2011

pdf bib
Proceedings of the UCNLG+Eval: Language Generation and Evaluation Workshop
Anja Belz | Roger Evans | Albert Gatt | Kristina Striegnitz
Proceedings of the UCNLG+Eval: Language Generation and Evaluation Workshop

2009

pdf bib
Proceedings of the 2009 Workshop on Language Generation and Summarisation (UCNLG+Sum 2009)
Anja Belz | Roger Evans | Sebastian Varges
Proceedings of the 2009 Workshop on Language Generation and Summarisation (UCNLG+Sum 2009)

2007

pdf
Modelling control in generation
Roger Evans | David Weir | John Carroll | Daniel Paiva | Anja Belz
Proceedings of the Eleventh European Workshop on Natural Language Generation (ENLG 07)

2006

pdf
Towards a validated model for affective classification of texts
Michel Généreux | Roger Evans
Proceedings of the Workshop on Sentiment and Subjectivity in Text

pdf
Implementing a Characterization of Genre for Automatic Genre Identification of Web Pages
Marina Santini | Richard Power | Roger Evans
Proceedings of the COLING/ACL 2006 Main Conference Poster Sessions

2005

pdf
Empirically-based Control of Natural Language Generation
Daniel S. Paiva | Roger Evans
Proceedings of the 43rd Annual Meeting of the Association for Computational Linguistics (ACL’05)

2004

pdf
Wysiwym with wider coverage
Richard Power | Roger Evans
Proceedings of the ACL Interactive Poster and Demonstration Sessions

2003

pdf
WYSIWYM - building user interfaces with natural language feedback
Roger Evans | Richard Power
Demonstrations

pdf
WASPBENCH: a lexicographer’s workbench incorporating state-of-the-art word sense disambiguation
Adam Kilgarriff | Roger Evans | Rob Koeling | Michael Rundell | David Tugwell
Demonstrations

pdf bib
An Evaluation of a Lexicographers’ Workbench: building lexicons for Machine Translation
Rob Koeling | Adam Kilgarriff | David Tugwell | Roger Evans
Proceedings of the 7th International EAMT workshop on MT and other language technology tools, Improving MT through other language technology tools, Resource and tools for building MT at EACL 2003

pdf bib
A Large-scale Inheritance-based Morphological Lexicon for Russian
Roger Evans | Carole Tiberius | Dunstan Brown | Greville C. Corbett
Proceedings of the 2003 EACL Workshop on Morphological Processing of Slavic Languages

2002

pdf
What is NLG?
Roger Evans | Paul Piwek | Lynne Cahill
Proceedings of the International Natural Language Generation Conference

2001

pdf
From RAGS to RICHES: Exploiting the Potential of a Flexible Generation Architecture
Lynne Cahill | John Carroll | Roger Evans | Daniel Paiva | Richard Power | Donia Scott | Kees van Deemter
Proceedings of the 39th Annual Meeting of the Association for Computational Linguistics

2000

pdf
A Representation for Complex and Evolving Data Dependencies in Generation
C Mellish | R Evans | L Cahill | C Doran | D Paiva | M Reape | D Scott | N Tipper
Sixth Applied Natural Language Processing Conference

pdf
Reinterpretation of an Existing NLG System in a Generic Generation Architecture
Lynne Cahill | Christy Doran | Roger Evans | Chris Mellish | Daniel Paiva | Mike Reape | Donia Scott | Neil Tipper
INLG’2000 Proceedings of the First International Conference on Natural Language Generation

pdf
Enabling Resource Sharing in Language Generation: an Abstract Reference Architecture
Lynne Cahill | Christy Doran | Roger Evans | Rodger Kibble | Chris Mellish | D. Paiva | Mike Reape | Donia Scott | Neil Tipper
Proceedings of the Second International Conference on Language Resources and Evaluation (LREC’00)

pdf
The Concede Model for Lexical Databases
Tomaž Erjavec | Roger Evans | Nancy Ide | Adam Kilgarriff
Proceedings of the Second International Conference on Language Resources and Evaluation (LREC’00)

1998

pdf
A Structure-sharing Parser for Lexicalized Grammars
Roger Evans | David Weir
36th Annual Meeting of the Association for Computational Linguistics and 17th International Conference on Computational Linguistics, Volume 1

pdf
A structure-sharing parser for lexicalized grammars
Roger Evans | David Weir
COLING 1998 Volume 1: The 17th International Conference on Computational Linguistics

pdf
A compact encoding of a DTG grammar
Martine Smets | Roger Evans
Proceedings of the Fourth International Workshop on Tree Adjoining Grammars and Related Frameworks (TAG+4)

pdf
Generation as a Solution to Its Own Problem
Donia Scott | Richard Power | Roger Evans
Natural Language Generation

1997

pdf
Automaton-based Parsing for Lexicalised Grammars
Roger Evans | David Weir
Proceedings of the Fifth International Workshop on Parsing Technologies

In wide-coverage lexicalized grammars many of the elementary structures have substructures in common. This means that during parsing some of the computation associated with different structures is duplicated. This paper explores ways in which the grammar can be precompiled into finite state automata so that some of this shared structure results in shared computation at run-time.

1996

pdf bib
DATR: A Language for Lexical Knowledge Representation
Roger Evans | Gerald Gazdar
Computational Linguistics, Volume 22, Number 2, June 1996

1995

pdf
Encoding Lexicalized Tree Adjoining Grammars with a Nonmonotonic Inheritance Hierarchy
Roger Evans | Gerald Gazdar | David Weir
33rd Annual Meeting of the Association for Computational Linguistics

1993

pdf
Sussex University: Description of the Sussex System Used for MUC-5
Robert Gaizauskas | Lynne Cahill | Roger Evans
Fifth Message Understanding Conference (MUC-5): Proceedings of a Conference Held in Baltimore, Maryland, August 25-27, 1993

1989

pdf bib
Natural Language Generation from Plans
Chris Mellish | Roger Evans
Computational Linguistics, Volume 15, Number 4, December 1989

pdf
Inference in DATR
Roger Evans | Gerald Gazdar
Fourth Conference of the European Chapter of the Association for Computational Linguistics