@inproceedings{voigt-etal-2021-challenges,
    title = "Challenges in Designing Natural Language Interfaces for Complex Visual Models",
    author = "Voigt, Henrik  and
      Meuschke, Monique  and
      Lawonn, Kai  and
      Zarrie{\ss}, Sina",
    editor = "Blodgett, Su Lin  and
      Madaio, Michael  and
      O'Connor, Brendan  and
      Wallach, Hanna  and
      Yang, Qian",
    booktitle = "Proceedings of the First Workshop on Bridging Human{--}Computer Interaction and Natural Language Processing",
    month = apr,
    year = "2021",
    address = "Online",
    publisher = "Association for Computational Linguistics",
    url = "https://preview.aclanthology.org/author-page-diogo-silva-nova/2021.hcinlp-1.11/",
    pages = "66--73",
    abstract = "Intuitive interaction with visual models becomes an increasingly important task in the field of Visualization (VIS) and verbal interaction represents a significant aspect of it. Vice versa, modeling verbal interaction in visual environments is a major trend in ongoing research in NLP. To date, research on Language {\&} Vision, however, mostly happens at the intersection of NLP and Computer Vision (CV), and much less at the intersection of NLP and Visualization, which is an important area in Human-Computer Interaction (HCI). This paper presents a brief survey of recent work on interactive tasks and set-ups in NLP and Visualization. We discuss the respective methods, show interesting gaps, and conclude by suggesting neural, visually grounded dialogue modeling as a promising potential for NLIs for visual models."
}