2022
pdf
abs
Conditional Language Models for Community-Level Linguistic Variation
Bill Noble
|
Jean-philippe Bernardy
Proceedings of the Fifth Workshop on Natural Language Processing and Computational Social Science (NLP+CSS)
Community-level linguistic variation is a core concept in sociolinguistics. In this paper, we use conditioned neural language models to learn vector representations for 510 online communities. We use these representations to measure linguistic variation between commu-nities and investigate the degree to which linguistic variation corresponds with social connections between communities. We find that our sociolinguistic embeddings are highly correlated with a social network-based representation that does not use any linguistic input.
pdf
bib
Classification Systems: Combining taxonomical and perceptual lexical meaning
Bill Noble
|
Staffan Larsson
|
Robin Cooper
Proceedings of the 3rd Natural Logic Meets Machine Learning Workshop (NALOMA III)
pdf
abs
In Search of Meaning and Its Representations for Computational Linguistics
Simon Dobnik
|
Robin Cooper
|
Adam Ek
|
Bill Noble
|
Staffan Larsson
|
Nikolai Ilinykh
|
Vladislav Maraev
|
Vidya Somashekarappa
Proceedings of the 2022 CLASP Conference on (Dis)embodiment
In this paper we examine different meaning representations that are commonly used in different natural language applications today and discuss their limits, both in terms of the aspects of the natural language meaning they are modelling and in terms of the aspects of the application for which they are used.
2021
pdf
abs
Semantic shift in social networks
Bill Noble
|
Asad Sayeed
|
Raquel Fernández
|
Staffan Larsson
Proceedings of *SEM 2021: The Tenth Joint Conference on Lexical and Computational Semantics
Just as the meaning of words is tied to the communities in which they are used, so too is semantic change. But how does lexical semantic change manifest differently across different communities? In this work, we investigate the relationship between community structure and semantic change in 45 communities from the social media website Reddit. We use distributional methods to quantify lexical semantic change and induce a social network on communities, based on interactions between members. We explore the relationship between semantic change and the clustering coefficient of a community’s social network graph, as well as community size and stability. While none of these factors are found to be significant on their own, we report a significant effect of their three-way interaction. We also report on significant word-level effects of frequency and change in frequency, which replicate previous findings.
pdf
abs
Large-scale text pre-training helps with dialogue act recognition, but not without fine-tuning
Bill Noble
|
Vladislav Maraev
Proceedings of the 14th International Conference on Computational Semantics (IWCS)
We use dialogue act recognition (DAR) to investigate how well BERT represents utterances in dialogue, and how fine-tuning and large-scale pre-training contribute to its performance. We find that while both the standard BERT pre-training and pretraining on dialogue-like data are useful, task-specific fine-tuning is essential for good performance.
2020
pdf
bib
abs
Personae under uncertainty: The case of topoi
Bill Noble
|
Ellen Breitholtz
|
Robin Cooper
Proceedings of the Probability and Meaning Conference (PaM 2020)
In this paper, we propose a probabilistic model of social signalling which adopts a persona-based account of social meaning. We use this model to develop a socio-semantic theory of conventionalised reasoning patterns, known as topoi. On this account the social meaning of a topos, as conveyed in a argument, is based on the set of idealogically-related topoi it indicates in context. We draw a connection between the role of personae in social meaning and the category adjustment effect, a well-known psychological phenomenon in which the representation of a stimulus is biased in the direction of the category in which it falls. Finally, we situate the interpretation of social signals as an update to the information state of an agent in a formal TTR model of dialogue.
2015
pdf
Centre Stage: How Social Network Position Shapes Linguistic Coordination
Bill Noble
|
Raquel Fernández
Proceedings of the 6th Workshop on Cognitive Modeling and Computational Linguistics