@inproceedings{zhu-etal-2025-multimodal-common,
    title = "Multimodal Common Ground Annotation for Partial Information Collaborative Problem Solving",
    author = "Zhu, Yifan  and
      Jung, Changsoo  and
      Lai, Kenneth  and
      Venkatesha, Videep  and
      Bradford, Mariah  and
      Fitzgerald, Jack  and
      Jamil, Huma  and
      Graff, Carine  and
      Kumar, Sai Kiran Ganesh  and
      Draper, Bruce  and
      Blanchard, Nathaniel  and
      Pustejovsky, James  and
      Krishnaswamy, Nikhil",
    editor = "Harry, Bunt",
    booktitle = "Proceedings of the 21st Joint ACL - ISO Workshop on Interoperable Semantic Annotation (ISA-21)",
    month = sep,
    year = "2025",
    address = {D{\"u}sseldorf, Germany},
    publisher = "Association for Computational Linguistics",
    url = "https://preview.aclanthology.org/iwcs-25-ingestion/2025.isa-1.9/",
    pages = "85--91",
    ISBN = "979-8-89176-319-7",
    abstract = "This project note describes challenges and procedures undertaken in annotating an audiovisual dataset capturing a multimodal situated collaborative construction task. In the task, all participants begin with different partial information, and must collaborate using speech, gesture, and action to arrive a solution that satisfies all individual pieces of private information. This rich data poses a number of annotation challenges, from small objects in a close space, to the implicit and multimodal fashion in which participants express agreement, disagreement, and beliefs. We discuss the data collection procedure, annotation schemas and tools, and future use cases."
}