Jet Hoek
2024
Subjectivity Theory vs. Speaker Intuitions: Explaining the Results of a Subjectivity Regressor Trained on Native Speaker Judgements
Elena Savinova | Jet Hoek
Proceedings of the 14th Workshop on Computational Approaches to Subjectivity, Sentiment, & Social Media Analysis
Elena Savinova | Jet Hoek
Proceedings of the 14th Workshop on Computational Approaches to Subjectivity, Sentiment, & Social Media Analysis
In this paper, we address the issue of explainability in a transformer-based subjectivity regressor trained on native English speakers’ judgements. The main goal of this work is to test how the regressor’s predictions, and therefore native speakers’ intuitions, relate to theoretical accounts of subjectivity. We approach this goal using two methods: a top-down manual selection of theoretically defined subjectivity features and a bottom-up extraction of top subjective and objective features using the LIME explanation method. The explainability of the subjectivity regressor is evaluated on a British news dataset containing sentences taken from social media news posts and from articles on the websites of the same news outlets. Both methods provide converging evidence that theoretically defined subjectivity features, such as emoji, evaluative adjectives, exclamations, questions, intensifiers, and first person pronouns, are prominent predictors of subjectivity scores. Thus, our findings show that the predictions of the regressor, and therefore native speakers’ perceptions of subjectivity, align with subjectivity theory. However, an additional comparison of the effects of different subjectivity features in author text and the text of cited sources reveals that the distinction between author and source subjectivity might not be as salient for naïve speakers as it is in the theory.
2021
Is there less annotator agreement when the discourse relation is underspecified?
Jet Hoek | Merel C.J. Scholman | Ted J.M. Sanders
Proceedings of the First Workshop on Integrating Perspectives on Discourse Annotation
Jet Hoek | Merel C.J. Scholman | Ted J.M. Sanders
Proceedings of the First Workshop on Integrating Perspectives on Discourse Annotation
Combined discourse representations: Coherence relations and questions under Discussion
Arndt Riester | Amalia Canes Nápoles | Jet Hoek
Proceedings of the First Workshop on Integrating Perspectives on Discourse Annotation
Arndt Riester | Amalia Canes Nápoles | Jet Hoek
Proceedings of the First Workshop on Integrating Perspectives on Discourse Annotation
2019
Proceedings of the 13th Linguistic Annotation Workshop
Annemarie Friedrich | Deniz Zeyrek | Jet Hoek
Proceedings of the 13th Linguistic Annotation Workshop
Annemarie Friedrich | Deniz Zeyrek | Jet Hoek
Proceedings of the 13th Linguistic Annotation Workshop
2017
Evaluating discourse annotation: Some recent insights and new approaches
Jet Hoek | Merel Scholman
Proceedings of the 13th Joint ISO-ACL Workshop on Interoperable Semantic Annotation (ISA-13)
Jet Hoek | Merel Scholman
Proceedings of the 13th Joint ISO-ACL Workshop on Interoperable Semantic Annotation (ISA-13)