Ivana Kruijff-Korbayová

Also published as: Ivana Kruijff-Korbayova, Ivana Kruijff-Korbayovà


2022

pdf
Chop and Change: Anaphora Resolution in Instructional Cooking Videos
Cennet Oguz | Ivana Kruijff-Korbayova | Emmanuel Vincent | Pascal Denis | Josef van Genabith
Findings of the Association for Computational Linguistics: AACL-IJCNLP 2022

Linguistic ambiguities arising from changes in entities in action flows are a key challenge in instructional cooking videos. In particular, temporally evolving entities present rich and to date understudied challenges for anaphora resolution. For example “oil” mixed with “salt” is later referred to as a “mixture”. In this paper we propose novel annotation guidelines to annotate recipes for the anaphora resolution task, reflecting change in entities. Moreover, we present experimental results for end-to-end multimodal anaphora resolution with the new annotation scheme and propose the use of temporal features for performance improvement.

2021

pdf
Automatic Assignment of Semantic Frames in Disaster Response Team Communication Dialogues
Natalia Skachkova | Ivana Kruijff-Korbayova
Proceedings of the 14th International Conference on Computational Semantics (IWCS)

We investigate frame semantics as a meaning representation framework for team communication in a disaster response scenario. We focus on the automatic frame assignment and retrain PAFIBERT, which is one of the state-of-the-art frame classifiers, on English and German disaster response team communication data, obtaining accuracy around 90%. We examine the performance of both models and discuss their adjustments, such as sampling of additional training instances from an unrelated domain and adding extra lexical and discourse features to input token representations. We show that sampling has some positive effect on the German frame classifier, discuss an unexpected impact of extra features on the models’ behaviour and perform a careful error analysis.

pdf
Anaphora Resolution in Dialogue: Description of the DFKI-TalkingRobots System for the CODI-CRAC 2021 Shared-Task
Tatiana Anikina | Cennet Oguz | Natalia Skachkova | Siyu Tao | Sharmila Upadhyaya | Ivana Kruijff-Korbayova
Proceedings of the CODI-CRAC 2021 Shared Task on Anaphora, Bridging, and Discourse Deixis in Dialogue

We describe the system developed by the DFKI-TalkingRobots Team for the CODI-CRAC 2021 Shared-Task on anaphora resolution in dialogue. Our system consists of three subsystems: (1) the Workspace Coreference System (WCS) incrementally clusters mentions using semantic similarity based on embeddings combined with lexical feature heuristics; (2) the Mention-to-Mention (M2M) coreference resolution system pairs same entity mentions; (3) the Discourse Deixis Resolution (DDR) system employs a Siamese Network to detect discourse anaphor-antecedent pairs. WCS achieved F1-score of 55.6% averaged across the evaluation test sets, M2M achieved 57.2% and DDR achieved 21.5%.

pdf
Anaphora Resolution in Dialogue: Cross-Team Analysis of the DFKI-TalkingRobots Team Submissions for the CODI-CRAC 2021 Shared-Task
Natalia Skachkova | Cennet Oguz | Tatiana Anikina | Siyu Tao | Sharmila Upadhyaya | Ivana Kruijff-Korbayova
Proceedings of the CODI-CRAC 2021 Shared Task on Anaphora, Bridging, and Discourse Deixis in Dialogue

We compare our team’s systems to others submitted for the CODI-CRAC 2021 Shared-Task on anaphora resolution in dialogue. We analyse the architectures and performance, report some problematic cases in gold annotations, and suggest possible improvements of the systems, their evaluation, data annotation, and the organization of the shared task.

2020

pdf
Reference in Team Communication for Robot-Assisted Disaster Response: An Initial Analysis
Natalia Skachkova | Ivana Kruijff-Korbayova
Proceedings of the Third Workshop on Computational Models of Reference, Anaphora and Coreference

We analyze reference phenomena in a corpus of robot-assisted disaster response team communication. The annotation scheme we designed for this purpose distinguishes different types of entities, roles, reference units and relations. We focus particularly on mission-relevant objects, locations and actors and also annotate a rich set of reference links, including co-reference and various other kinds of relations. We explain the categories used in our annotation, present their distribution in the corpus and discuss challenging cases.

2019

pdf
Dialogue Act Classification in Team Communication for Robot Assisted Disaster Response
Tatiana Anikina | Ivana Kruijff-Korbayova
Proceedings of the 20th Annual SIGdial Meeting on Discourse and Dialogue

We present the results we obtained on the classification of dialogue acts in a corpus of human-human team communication in the domain of robot-assisted disaster response. We annotated dialogue acts according to the ISO 24617-2 standard scheme and carried out experiments using the FastText linear classifier as well as several neural architectures, including feed-forward, recurrent and convolutional neural models with different types of embeddings, context and attention mechanism. The best performance was achieved with a ”Divide & Merge” architecture presented in the paper, using trainable GloVe embeddings and a structured dialogue history. This model learns from the current utterance and the preceding context separately and then combines the two generated representations. Average accuracy of 10-fold cross-validation is 79.8%, F-score 71.8%.

pdf
Multi-Task Learning of System Dialogue Act Selection for Supervised Pretraining of Goal-Oriented Dialogue Policies
Sarah McLeod | Ivana Kruijff-Korbayova | Bernd Kiefer
Proceedings of the 20th Annual SIGdial Meeting on Discourse and Dialogue

This paper describes the use of Multi-Task Neural Networks (NNs) for system dialogue act selection. These models leverage the representations learned by the Natural Language Understanding (NLU) unit to enable robust initialization/bootstrapping of dialogue policies from medium sized initial data sets. We evaluate the models on two goal-oriented dialogue corpora in the travel booking domain. Results show the proposed models improve over models trained without knowledge of NLU tasks.

2012

pdf
An Interactive Humanoid Robot Exhibiting Flexible Sub-Dialogues
Heriberto Cuayáhuitl | Ivana Kruijff-Korbayová
Proceedings of the Demonstration Session at the Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies

pdf
Hierarchical Dialogue Policy Learning using Flexible State Transitions and Linear Function Approximation
Heriberto Cuayáhuitl | Ivana Kruijff-Korbayová | Nina Dethlefs
Proceedings of COLING 2012: Demonstration Papers

2009

pdf
A Situated Context Model for Resolution and Generation of Referring Expressions
Hendrik Zender | Geert-Jan M. Kruijff | Ivana Kruijff-Korbayová
Proceedings of the 12th European Workshop on Natural Language Generation (ENLG 2009)

2008

pdf
The Effect of Dialogue System Output Style Variation on Users’ Evaluation Judgments and Input Style
Ivana Kruijff-Korbayová | Olga Kukina
Proceedings of the 9th SIGdial Workshop on Discourse and Dialogue

pdf
The Effect of Dialogue System Output Style Variation on Users’ Evaluation Judgments and Input Style
Ivana Kruijff-Korbayová | Ciprian Gerstenberger | Olga Kukina | Jan Schehl
Proceedings of the Fifth International Natural Language Generation Conference

2006

pdf
The SAMMIE Multimodal Dialogue Corpus Meets the Nite XML Toolkit
Ivana Kruijff-Korbayová | Verena Rieser | Ciprian Gerstenberger | Jan Schehl | Tilman Becker
Proceedings of the 5th Workshop on NLP and XML (NLPXML-2006): Multi-Dimensional Markup in Natural Language Processing

pdf
The SAMMIE System: Multimodal In-Car Dialogue
Tilman Becker | Peter Poller | Jan Schehl | Nate Blaylock | Ciprian Gerstenberger | Ivana Kruijff-Korbayová
Proceedings of the COLING/ACL 2006 Interactive Presentation Sessions

pdf
Annotation Guidelines for Czech-English Word Alignment
Ivana Kruijff-Korbayová | Klára Chvátalová | Oana Postolache
Proceedings of the Fifth International Conference on Language Resources and Evaluation (LREC’06)

We report on our experience with manual alignment of Czech and English parallel corpus text. We applied existing guidelines for English and French and augmented them to cover systematically occurring cases in our corpus. We describe the main extensions covered in our guidelines and provide examples. We evaluated both intra- and inter-annotator agreement and obtained very good results of Kappa well above 0.9 and agreement of 95% and 93%, respectively.

pdf
The SAMMIE Corpus of Multimodal Dialogues with an MP3 Player
Ivana Kruijff-Korbayová | Tilman Becker | Nate Blaylock | Ciprian Gerstenberger | Michael Kaißer | Peter Poller | Verena Rieser | Jan Schehl
Proceedings of the Fifth International Conference on Language Resources and Evaluation (LREC’06)

We describe a corpus of multimodal dialogues with an MP3player collected in Wizard-of-Oz experiments and annotated with a richfeature set at several layers. We are using the Nite XML Toolkit (NXT) to represent and further process the data. We designed an NXTdata model, converted experiment log file data and manualtranscriptions into NXT, and are building tools for additionalannotation using NXT libraries. The annotated corpus will be used to (i) investigate various aspects of multimodal presentation andinteraction strategies both within and across annotation layers; (ii) design an initial policy for reinforcement learning of multimodalclarification requests.

pdf
A corpus of tutorial dialogs on theorem proving; the influence of the presentation of the study-material
Christoph Benzmüller | Helmut Horacek | Henri Lesourd | Ivana Kruijff-Korbayova | Marvin Schiller | Magdalena Wolska
Proceedings of the Fifth International Conference on Language Resources and Evaluation (LREC’06)

We present a new corpus of tutorial dialogs on mathematical theorem proving that was collected in a Wizard-of-Oz setup. Our study is a follow up on a previous experiment conducted in a similar simulated environment. A major difference between the current and the previous experimental setup was that in this study we varied the presentation of the study-material with which the subjects were provided. One sub-group of the subjects was presented with a highly formalized presentation consisting mainly of formulas, while the other with a presentation mainly in natural language. Our goal was to obtain more data on the kind of mixed-language that is characteristic of informal mathematical discourse. We hypothesized that the language style of the subjects' interaction with the simulated system will reflect the style of presentation of the study-material. In the paper we briefly present the experimental setup, the corpus, and a preliminary quantitative result of the corpus analysis.

2005

pdf
An Experiment Setup for Collecting Data for Adaptive Output Planning in a Multimodal Dialogue System
Ivana Kruijff-Korbayová | Nate Blaylock | Ciprian Gerstenberger | Verena Rieser | Tilman Becker | Michael Kaisser | Peter Poller | Jan Schehl
Proceedings of the Tenth European Workshop on Natural Language Generation (ENLG-05)

pdf
A Corpus Collection and Annotation Framework for Learning Multimodal Clarification Strategies
Verena Rieser | Ivana Kruijff-Korbayová | Oliver Lemon
Proceedings of the 6th SIGdial Workshop on Discourse and Dialogue

pdf bib
Data-driven Approaches for Information Structure Identification
Oana Postolache | Ivana Kruijff-Korbayová | Geert-Jan Kruijff
Proceedings of Human Language Technology Conference and Conference on Empirical Methods in Natural Language Processing

2004

pdf
The MULI Project: Annotation and Analysis of Information Structure in German and English
Stefan Baumann | Caren Brinckmann | Silvia Hansen-Schirra | Geert-Jan Kruijff | Ivana Kruijff-Korbayová | Stella Neumann | Erich Steiner | Elke Teich | Hans Uszkoreit
Proceedings of the Fourth International Conference on Language Resources and Evaluation (LREC’04)

pdf
An Annotated Corpus of Tutorial Dialogs on Mathematical Theorem Proving
Magdalena Wolska | Bao Quoc Vo | Dimitra Tsovaltzi | Ivana Kruijff-Korbayová | Elena Karagjosova | Helmut Horacek | Armin Fiedler | Christoph Benzmüller
Proceedings of the Fourth International Conference on Language Resources and Evaluation (LREC’04)

pdf
Discourse-level Annotation for Investigating Information Structure
Ivana Kruijff-Korbayova | Geert-Jan M. Kruijff
Proceedings of the Workshop on Discourse Annotation

pdf
Lexical-semantic interpretation of language input in mathematical dialogs
Magdalena Wolska | Ivana Kruijff-Korbayová | Helmut Horacek
Proceedings of the 2nd Workshop on Text Meaning and Interpretation

pdf
Multi-dimensional annotation of linguistic corpora for investigating information structure
Stefan Baumann | Caren Brinckmann | Silvia Hansen-Schirra | Geert-Jan Kruijff | Ivana Kruijff-Korbayová | Stella Neumann | Elke Teich
Proceedings of the Workshop Frontiers in Corpus Annotation at HLT-NAACL 2004

pdf
Analysis of Mixed Natural and Symbolic Input in Mathematical Dialogs
Magdalena Wolska | Ivana Kruijff-Korbayová
Proceedings of the 42nd Annual Meeting of the Association for Computational Linguistics (ACL-04)

2003

pdf
Producing Contextually Appropriate Intonation is an Information-State Based Dialogue System
Ivana Kruijff-Korbayova | Stina Ericsson | Kepa J. Rodríguez | Elena Karagjosova
10th Conference of the European Chapter of the Association for Computational Linguistics

pdf
A dialogue system with contextually appropriate spoken output intonation
Ivana Kruijff-Korbayova | Elena Karagjosova | Kepa Joseba Rodriguez | Stina Ericsson
Demonstrations

2002

pdf
Conditional responses in information-seeking dialogues
Elena Karagjosova | Ivana Kruijff-Korbayova
Proceedings of the Third SIGdial Workshop on Discourse and Dialogue

2001

pdf
Linear Order as Higher-Level Decision: Information Structure in Strategic and Tactical Generation
Geert-Jan M. Kruijff | Ivana Kruijff-Korbayovà | John Bateman | Elke Teich
Proceedings of the ACL 2001 Eighth European Workshop on Natural Language Generation (EWNLG)

2000

pdf
Multilinguality in a Text Generation System For Three Slavic Languages
Geert-Jan Kruijff | Elke Teich | John Bateman | Ivana Kruijff-Korbayova | Hana Skoumalova | Serge Sharoff | Lena Sokolova | Tony Hartley | Kamenka Staykova | Jiri Hana
COLING 2000 Volume 1: The 18th International Conference on Computational Linguistics

pdf
Resources for Multilingual Text Generation in Three Slavic Languages
John Bateman | Elke Teich | Geert-Jan Kruijff | Ivana Kruijff-Korbayová | Serge Sharoff | Hana Skoumalová
Proceedings of the Second International Conference on Language Resources and Evaluation (LREC’00)