Workshop on Computational Models of Reference, Anaphora and Coreference (2024)
up
Proceedings of the Seventh Workshop on Computational Models of Reference, Anaphora and Coreference
Proceedings of the Seventh Workshop on Computational Models of Reference, Anaphora and Coreference
Maciej Ogrodniczuk | Anna Nedoluzhko | Massimo Poesio | Sameer Pradhan | Vincent Ng
Maciej Ogrodniczuk | Anna Nedoluzhko | Massimo Poesio | Sameer Pradhan | Vincent Ng
Major Entity Identification: A Generalizable Alternative to Coreference Resolution
Kawshik Manikantan | Shubham Toshniwal | Makarand Tapaswi | Vineet Gandhi
Kawshik Manikantan | Shubham Toshniwal | Makarand Tapaswi | Vineet Gandhi
Enriching Conceptual Knowledge in Language Models through Metaphorical Reference Explanation
Zixuan Zhang | Heng Ji
Zixuan Zhang | Heng Ji
Polish Coreference Corpus as an LLM Testbed: Evaluating Coreference Resolution within Instruction-Following Language Models by Instruction–Answer Alignment
Karol Saputa | Angelika Peljak-Łapińska | Maciej Ogrodniczuk
Karol Saputa | Angelika Peljak-Łapińska | Maciej Ogrodniczuk
MSCAW-coref: Multilingual, Singleton and Conjunction-Aware Word-Level Coreference Resolution
Houjun Liu | John Bauer | Karel D’Oosterlinck | Christopher Potts | Christopher D. Manning
Houjun Liu | John Bauer | Karel D’Oosterlinck | Christopher Potts | Christopher D. Manning
Unifying the Scope of Bridging Anaphora Types in English: Bridging Annotations in ARRAU and GUM
Lauren Levine | Amir Zeldes
Lauren Levine | Amir Zeldes
WinoPron: Revisiting English Winogender Schemas for Consistency, Coverage, and Grammatical Case
Vagrant Gautam | Julius Steuer | Eileen Bingert | Ray Johns | Anne Lauscher | Dietrich Klakow
Vagrant Gautam | Julius Steuer | Eileen Bingert | Ray Johns | Anne Lauscher | Dietrich Klakow
While measuring bias and robustness in coreference resolution are important goals, such measurements are only as good as the tools we use to measure them. Winogender Schemas (Rudinger et al., 2018) are an influential dataset proposed to evaluate gender bias in coreference resolution, but a closer look reveals issues with the data that compromise its use for reliable evaluation, including treating different pronominal forms as equivalent, violations of template constraints, and typographical errors. We identify these issues and fix them, contributing a new dataset: WinoPron. Using WinoPron, we evaluate two state-of-the-art supervised coreference resolution systems, SpanBERT, and five sizes of FLAN-T5, and demonstrate that accusative pronouns are harder to resolve for all models. We also propose a new method to evaluate pronominal bias in coreference resolution that goes beyond the binary. With this method, we also show that bias characteristics vary not just across pronoun sets (e.g., he vs. she), but also across surface forms of those sets (e.g., him vs. his).
DeepHCoref: A Deep Neural Coreference Resolution for Hindi Text
Kusum Lata | Pardeep Singh | Kamlesh Dutta | Abhishek Kanwar
Kusum Lata | Pardeep Singh | Kamlesh Dutta | Abhishek Kanwar
Findings of the Third Shared Task on Multilingual Coreference Resolution
Michal Novák | Barbora Dohnalová | Miloslav Konopik | Anna Nedoluzhko | Martin Popel | Ondrej Prazak | Jakub Sido | Milan Straka | Zdeněk Žabokrtský | Daniel Zeman
Michal Novák | Barbora Dohnalová | Miloslav Konopik | Anna Nedoluzhko | Martin Popel | Ondrej Prazak | Jakub Sido | Milan Straka | Zdeněk Žabokrtský | Daniel Zeman