Yulla Liquer Navarro
2026
Evaluating the Impact of LLM-Assisted Annotation in a Perspectivized Setting: The Case of FrameNet Annotation
Frederico Belcavello | Ely E. Matos | Arthur Lorenzi | Lisandra Bonoto | Livia Pádua Ruiz | Luiz Fernando Pereira | Victor Herbst | Yulla Liquer Navarro | Helen de Andrade Abreu | Lívia Vicente Dutra | Tiago Timponi Torrent
Proceedings of the 22nd Joint ACL - ISO Workshop on Interoperable Semantic Annotation and Representation (ISA-22) @ LREC 2026
Frederico Belcavello | Ely E. Matos | Arthur Lorenzi | Lisandra Bonoto | Livia Pádua Ruiz | Luiz Fernando Pereira | Victor Herbst | Yulla Liquer Navarro | Helen de Andrade Abreu | Lívia Vicente Dutra | Tiago Timponi Torrent
Proceedings of the 22nd Joint ACL - ISO Workshop on Interoperable Semantic Annotation and Representation (ISA-22) @ LREC 2026
The use of LLM-based applications as a means to accelerate and/or substitute human labor in the creation of language resources and datasets is a reality. Nonetheless, despite the potential of such tools for linguistic research, an evaluation of their performance and impact on the creation of annotated datasets, especially under a perspectivized approach to NLP, is still missing. This paper contributes to the reduction of this gap by reporting on an extensive evaluation of the (semi-)automatization of FrameNet-like semantic annotation by the use of an LLM-based semantic role labeler. The methodology employed compares annotation time, coverage, and diversity in three experimental settings: manual, automatic, and semi-automatic annotation. Results show that the hybrid, semi-automatic annotation setting leads to increased frame diversity and similar annotation coverage, when compared to the human-only setting, while the automatic setting performs considerably worse in all metrics, except for annotation time, which remains similar.
2025
Audition: A Frame-Annotated Multimodal Dataset for Accessible Audiovisual Content
Maucha Andrade Gamonal | Tiago Timponi Torrent | Ely Edison Matos | Adriana S. Pagano | Frederico Belcavello | Flávia Affonso Mayer | Arthur Lorenzi | Natalia S. Sigiliano | Helen de Andrade Abreu | Lívia Vicente Dutra | Marcelo Viridiano | André Coneglian | Victor A. S. Herbst | Franciany O. Campos | Kenneth Brown | Lívia Padua Ruiz | Lisandra Carvalho Bonoto | Luiz Fernando Pereira | Yulla Liquer Navarro
Proceedings of the 21st Joint ACL - ISO Workshop on Interoperable Semantic Annotation (ISA-21)
Maucha Andrade Gamonal | Tiago Timponi Torrent | Ely Edison Matos | Adriana S. Pagano | Frederico Belcavello | Flávia Affonso Mayer | Arthur Lorenzi | Natalia S. Sigiliano | Helen de Andrade Abreu | Lívia Vicente Dutra | Marcelo Viridiano | André Coneglian | Victor A. S. Herbst | Franciany O. Campos | Kenneth Brown | Lívia Padua Ruiz | Lisandra Carvalho Bonoto | Luiz Fernando Pereira | Yulla Liquer Navarro
Proceedings of the 21st Joint ACL - ISO Workshop on Interoperable Semantic Annotation (ISA-21)
This paper presents a multimodal semantic analysis of accessible Brazilian short films using a frame-based annotation approach. We introduce a subset of the Audition dataset, comprising six short films from the animation and documentary genres. We analysed three communicative modes: original audio, audio description, and visual content. Trained annotators semantically annotated each mode following the FrameNet Brazil multimodal methodology. To compare meaning across modalities, we used cosine similarity over frame-semantic representations. Results show that audio description aligns more closely with video content than original audio, reflecting its role in translating visual meaning into language. Our findings demonstrate the effectiveness of frame semantics in modelling meaning across modalities and provide quantitative evidence of audio description as a bridge between visual and verbal communication. The dataset and annotation strategies are a valuable resource for research on multimodal representation, semantic similarity, and accessible media.
Search
Fix author
Co-authors
- Helen de Andrade Abreu 2
- Frederico Belcavello 2
- Lívia Vicente Dutra 2
- Arthur Lorenzi 2
- Luiz Fernando Pereira 2
- Lívia Pádua Ruiz 2
- Tiago Timponi Torrent 2
- Lisandra Bonoto 1
- Lisandra Carvalho Bonoto 1
- Kenneth Brown 1
- Franciany O. Campos 1
- André Coneglian 1
- Maucha Andrade Gamonal 1
- Victor Herbst 1
- Victor A. S. Herbst 1
- Ely E. Matos 1
- Ely Edison Matos 1
- Flávia Affonso Mayer 1
- Adriana Silvina Pagano 1
- Natalia S. Sigiliano 1
- Marcelo Viridiano 1