Blerta Veseli
2023
Evaluating the Knowledge Base Completion Potential of GPT
Blerta Veseli
|
Simon Razniewski
|
Jan-Christoph Kalo
|
Gerhard Weikum
Findings of the Association for Computational Linguistics: EMNLP 2023
Structured knowledge bases (KBs) are an asset for search engines and other applications but are inevitably incomplete. Language models (LMs) have been proposed for unsupervised knowledge base completion (KBC), yet, their ability to do this at scale and with high accuracy remains an open question. Prior experimental studies mostly fall short because they only evaluate on popular subjects, or sample already existing facts from KBs. In this work, we perform a careful evaluation of GPT’s potential to complete the largest public KB: Wikidata. We find that, despite their size and capabilities, models like GPT-3, ChatGPT and GPT-4 do not achieve fully convincing results on this task. Nonetheless, it provides solid improvements over earlier approaches with smaller LMs. In particular, we show that it is feasible to extend Wikidata by 27M facts at 90% precision.
2020
Improving Sentiment Analysis with Biofeedback Data
Daniel Schlör
|
Albin Zehe
|
Konstantin Kobs
|
Blerta Veseli
|
Franziska Westermeier
|
Larissa Brübach
|
Daniel Roth
|
Marc Erich Latoschik
|
Andreas Hotho
Proceedings of LREC2020 Workshop "People in language, vision and the mind" (ONION2020)
Humans frequently are able to read and interpret emotions of others by directly taking verbal and non-verbal signals in human-to-human communication into account or to infer or even experience emotions from mediated stories. For computers, however, emotion recognition is a complex problem: Thoughts and feelings are the roots of many behavioural responses and they are deeply entangled with neurophysiological changes within humans. As such, emotions are very subjective, often are expressed in a subtle manner, and are highly depending on context. For example, machine learning approaches for text-based sentiment analysis often rely on incorporating sentiment lexicons or language models to capture the contextual meaning. This paper explores if and how we further can enhance sentiment analysis using biofeedback of humans which are experiencing emotions while reading texts. Specifically, we record the heart rate and brain waves of readers that are presented with short texts which have been annotated with the emotions they induce. We use these physiological signals to improve the performance of a lexicon-based sentiment classifier. We find that the combination of several biosignals can improve the ability of a text-based classifier to detect the presence of a sentiment in a text on a per-sentence level.
Search
Co-authors
- Simon Razniewski 1
- Jan-Christoph Kalo 1
- Gerhard Weikum 1
- Daniel Schlör 1
- Albin Zehe 1
- show all...