Ruiqing Yin
2022
Bazinga! A Dataset for Multi-Party Dialogues Structuring
Paul Lerner
|
Juliette Bergoënd
|
Camille Guinaudeau
|
Hervé Bredin
|
Benjamin Maurice
|
Sharleyne Lefevre
|
Martin Bouteiller
|
Aman Berhe
|
Léo Galmant
|
Ruiqing Yin
|
Claude Barras
Proceedings of the Thirteenth Language Resources and Evaluation Conference
We introduce a dataset built around a large collection of TV (and movie) series. Those are filled with challenging multi-party dialogues. Moreover, TV series come with a very active fan base that allows the collection of metadata and accelerates annotation. With 16 TV and movie series, Bazinga! amounts to 400+ hours of speech and 8M+ tokens, including 500K+ tokens annotated with the speaker, addressee, and entity linking information. Along with the dataset, we also provide a baseline for speaker diarization, punctuation restoration, and person entity recognition. The results demonstrate the difficulty of the tasks and of transfer learning from models trained on mono-speaker audio or written text, which is more widely available. This work is a step towards better multi-party dialogue structuring and understanding. Bazinga! is available at hf.co/bazinga. Because (a large) part of Bazinga! is only partially annotated, we also expect this dataset to foster research towards self- or weakly-supervised learning methods.
2018
Efficient Generation and Processing of Word Co-occurrence Networks Using corpus2graph
Zheng Zhang
|
Pierre Zweigenbaum
|
Ruiqing Yin
Proceedings of the Twelfth Workshop on Graph-Based Methods for Natural Language Processing (TextGraphs-12)
Corpus2graph is an open-source NLP-application-oriented tool that generates a word co-occurrence network from a large corpus. It not only contains different built-in methods to preprocess words, analyze sentences, extract word pairs and define edge weights, but also supports user-customized functions. By using parallelization techniques, it can generate a large word co-occurrence network of the whole English Wikipedia data within hours. And thanks to its nodes-edges-weight three-level progressive calculation design, rebuilding networks with different configurations is even faster as it does not need to start all over again. This tool also works with other graph libraries such as igraph, NetworkX and graph-tool as a front end providing data to boost network generation speed.
Search
Co-authors
- Zheng Zhang 1
- Pierre Zweigenbaum 1
- Paul Lerner 1
- Juliette Bergoënd 1
- Camille Guinaudeau 1
- show all...