Célia da Costa Pereira
2016
DRANZIERA: An Evaluation Protocol For Multi-Domain Opinion Mining
Mauro Dragoni
|
Andrea Tettamanzi
|
Célia da Costa Pereira
Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC'16)
Opinion Mining is a topic which attracted a lot of interest in the last years. By observing the literature, it is often hard to replicate system evaluation due to the unavailability of the data used for the evaluation or to the lack of details about the protocol used in the campaign. In this paper, we propose an evaluation protocol, called DRANZIERA, composed of a multi-domain dataset and guidelines allowing both to evaluate opinion mining systems in different contexts (Closed, Semi-Open, and Open) and to compare them to each other and to a number of baselines.