A multimodal interpreter for 3D visualization and animation of verbal concepts
Coline Claude-Lachenaud, Éric Charton, Benoît Ozell, Michel Gagnon
Abstract
We present an algorithm intended to visually represent the sense of verb related to an object described in a text sequence, as a movement in 3D space. We describe a specific semantic analyzer, based on a standard verbal ontology, dedicated to the interpretation of action verbs as spatial actions. Using this analyzer, our system build a generic 3D graphical path for verbal concepts allowing space representation, listed as SelfMotion concepts in the FrameNet ontology project. The object movement is build by first extracting the words and enriching them with the semantic analyzer. Then, weight tables, necessary to obtain characteristics values (orientation, shape, trajectory...) for the verb are used in order to get a 3D path, as realist as possible. The weight tables were created to make parallel between features defined for SelfMotion verbal concept (some provided by FrameNet, other determined during the project) and values used in the final algorithm used to create 3D moving representations from input text. We evaluate our analyzer on a corpus of short sentences and presents our results.- Anthology ID:
- L14-1585
- Volume:
- Proceedings of the Ninth International Conference on Language Resources and Evaluation (LREC'14)
- Month:
- May
- Year:
- 2014
- Address:
- Reykjavik, Iceland
- Editors:
- Nicoletta Calzolari, Khalid Choukri, Thierry Declerck, Hrafn Loftsson, Bente Maegaard, Joseph Mariani, Asuncion Moreno, Jan Odijk, Stelios Piperidis
- Venue:
- LREC
- SIG:
- Publisher:
- European Language Resources Association (ELRA)
- Note:
- Pages:
- 3620–3627
- Language:
- URL:
- http://www.lrec-conf.org/proceedings/lrec2014/pdf/747_Paper.pdf
- DOI:
- Cite (ACL):
- Coline Claude-Lachenaud, Éric Charton, Benoît Ozell, and Michel Gagnon. 2014. A multimodal interpreter for 3D visualization and animation of verbal concepts. In Proceedings of the Ninth International Conference on Language Resources and Evaluation (LREC'14), pages 3620–3627, Reykjavik, Iceland. European Language Resources Association (ELRA).
- Cite (Informal):
- A multimodal interpreter for 3D visualization and animation of verbal concepts (Claude-Lachenaud et al., LREC 2014)
- PDF:
- http://www.lrec-conf.org/proceedings/lrec2014/pdf/747_Paper.pdf