Valentina Presutti
2026
Victim or Assailant? Exploring Narratives through Knowledge Graph Queries
Beatrice Fiumanò | Nicolas Lazzari | Simone Paolo Ponzetto | Valentina Presutti
Proceedings of 10th Workshop on Linked Data in Linguistics (LDL-2026)
Beatrice Fiumanò | Nicolas Lazzari | Simone Paolo Ponzetto | Valentina Presutti
Proceedings of 10th Workshop on Linked Data in Linguistics (LDL-2026)
Our understanding of social reality is shaped by the specific ways in which that reality is framed by different sources. Analyzing framing means examining how these sources are able to convey particular worldviews by foregrounding or downplaying certain aspects of experience. Current computational approaches address this task by automatically identifying communicative patterns (e.g., topic selection or rhetorical strategies) that characterize individual artifacts. However, they often remain document-bound, overlooking the comparative dimension that enables the uncovering of convergent or conflicting narratives about the same actor, event, or issue. In this paper, we propose DORIS, an ontology that supports both document-level and cross-document framing analysis using SPARQL queries on automatically constructed Knowledge Graphs. We validate the proposed approach through a case study of historical news articles, exploring multiple framings of a real-world event using Fillmore’s Frame Semantics and the FrameNet resource. Code and data are available on GitHub at https://github.com/beatrice-f/DORIS/.
2025
KE-MHISTO: Towards a Multilingual Historical Knowledge Extraction Benchmark for Addressing the Long-Tail Problem
Arianna Graciotti | Leonardo Piano | Nicolas Lazzari | Enrico Daga | Rocco Tripodi | Valentina Presutti | Livio Pompianu
Findings of the Association for Computational Linguistics: ACL 2025
Arianna Graciotti | Leonardo Piano | Nicolas Lazzari | Enrico Daga | Rocco Tripodi | Valentina Presutti | Livio Pompianu
Findings of the Association for Computational Linguistics: ACL 2025
Large Language Models (LLMs) face significant challenges when queried about long-tail knowledge, i.e., information that is rarely encountered during their training process. These difficulties arise due to the inherent sparsity of such data. Furthermore, LLMs often lack the ability to verify or ground their responses in authoritative sources, which can lead to plausible yet inaccurate outputs when addressing infrequent subject matter. Our work aims to investigate these phenomena by introducing KE-MHISTO, a multilingual benchmark for Entity Linking and Question Answering in the domain of historical music knowledge, available in both Italian and English. We demonstrate that KE-MHISTO provides significantly broader coverage of long-tail knowledge compared to existing alternatives. Moreover, it poses substantial challenges for state-of-the-art models. Our experiments reveal that smaller, multilingual models can achieve performance comparable to significantly larger counterparts, highlighting the potential of efficient, language-aware approaches for long-tail knowledge extraction. KE-MHISTO is available at: https://github.com/polifonia-project/KE-MHISTO.
Unveiling Stereotypes: Combining Knowledge Graphs and LLMs for Implied Stereotype Generation
Marco Cuccarini | Lia Draetta | Beatrice Fiumanò | Stefano Bistarelli | Rossana Damiano | Valentina Presutti
Proceedings of the Eleventh Italian Conference on Computational Linguistics (CLiC-it 2025)
Marco Cuccarini | Lia Draetta | Beatrice Fiumanò | Stefano Bistarelli | Rossana Damiano | Valentina Presutti
Proceedings of the Eleventh Italian Conference on Computational Linguistics (CLiC-it 2025)
2024
Latent vs Explicit Knowledge Representation: How ChatGPT Answers Questions about Low-Frequency Entities
Arianna Graciotti | Valentina Presutti | Rocco Tripodi
Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024)
Arianna Graciotti | Valentina Presutti | Rocco Tripodi
Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024)
In this paper, we present an evaluation of two different approaches to the free-form Question Answering (QA) task. The main difference between the two approaches is that one is based on latent representations of knowledge, and the other uses explicit knowledge representation. For the evaluation, we developed DynaKnowledge, a new benchmark composed of questions concerning Wikipedia low-frequency entities. We wanted to ensure, on the one hand, that the questions are answerable and, on the other, that the models can provide information about very specific facts. The evaluation that we conducted highlights that the proposed benchmark is particularly challenging. The best model answers correctly only on 50% of the questions. Analysing the results, we also found that ChatGPT shows low reliance on low-frequency entity questions, manifesting a popularity bias. On the other hand, a simpler model based on explicit knowledge is less affected by this bias. With this paper, we want to provide a living benchmark for open-form QA to test knowledge and latent representation models on a dynamic benchmark.