Hiromi Wakaki


2021

pdf bib
Fundamental Exploration of Evaluation Metrics for Persona Characteristics of Text Utterances
Chiaki Miyazaki | Saya Kanno | Makoto Yoda | Junya Ono | Hiromi Wakaki
Proceedings of the 22nd Annual Meeting of the Special Interest Group on Discourse and Dialogue

To maintain utterance quality of a persona-aware dialog system, inappropriate utterances for the persona should be thoroughly filtered. When evaluating the appropriateness of a large number of arbitrary utterances to be registered in the utterance database of a retrieval-based dialog system, evaluation metrics that require a reference (or a “correct” utterance) for each evaluation target cannot be used. In addition, practical utterance filtering requires the ability to select utterances based on the intensity of persona characteristics. Therefore, we are developing metrics that can be used to capture the intensity of persona characteristics and can be computed without references tailored to the evaluation targets. To this end, we explore existing metrics and propose two new metrics: persona speaker probability and persona term salience. Experimental results show that our proposed metrics show weak to moderate correlations between scores of persona characteristics based on human judgments and outperform other metrics overall in filtering inappropriate utterances for particular personas.

2011

pdf bib
The Semi-Automatic Construction of Part-Of-Speech Taggers for Specific Languages by Statistical Methods
Tomohiro Yamasaki | Hiromi Wakaki | Masaru Suzuki
Proceedings of the 2nd Workshop on South Southeast Asian Natural Language Processing (WSSANLP)

pdf bib
Topic Models with Logical Constraints on Words
Hayato Kobayashi | Hiromi Wakaki | Tomohiro Yamasaki | Masaru Suzuki
Proceedings of Workshop on Robust Unsupervised and Semisupervised Methods in Natural Language Processing

2009

pdf bib
Abbreviation Generation for Japanese Multi-Word Expressions
Hiromi Wakaki | Hiroko Fujii | Masaru Suzuki | Mika Fukui | Kazuo Sumita
Proceedings of the Workshop on Multiword Expressions: Identification, Interpretation, Disambiguation and Applications (MWE 2009)