An Abstract Specification of VoxML as an Annotation Language

Kiyong Lee, Nikhil Krishnaswamy, James Pustejovsky


Abstract
VoxML is a modeling language used to map natural language expressions into real time visualizations using real-world semantic knowledge of objects and events. Its utility has been demonstrated in embodied simulation environmens and in agent-object interactions in situated human-agent communicative. It is enriched to work with notions of affordances, both Gibsonian and Telic, and habitat for various interactions between the rational agent (human) and an object. This paper aims to specify VoxML as an annotation language in general abstract terms. It then shows how it works on annotating linguistic data that express visually perceptible human-object interactions. The annotation structures thus generated will be interpreted against the enriched minimal model created by VoxML as a modeling language while supporting the modeling purposes of VoxML linguistically.
Anthology ID:
2023.isa-1.9
Volume:
Proceedings of the 19th Joint ACL-ISO Workshop on Interoperable Semantics (ISA-19)
Month:
June
Year:
2023
Address:
Nancy, France
Editor:
Harry Bunt
Venues:
ISA | WS
SIG:
SIGSEM
Publisher:
Association for Computational Linguistics
Note:
Pages:
66–74
Language:
URL:
https://aclanthology.org/2023.isa-1.9
DOI:
Bibkey:
Cite (ACL):
Kiyong Lee, Nikhil Krishnaswamy, and James Pustejovsky. 2023. An Abstract Specification of VoxML as an Annotation Language. In Proceedings of the 19th Joint ACL-ISO Workshop on Interoperable Semantics (ISA-19), pages 66–74, Nancy, France. Association for Computational Linguistics.
Cite (Informal):
An Abstract Specification of VoxML as an Annotation Language (Lee et al., ISA-WS 2023)
Copy Citation:
PDF:
https://preview.aclanthology.org/emnlp-22-attachments/2023.isa-1.9.pdf