NL-FIIT at SemEval-2019 Task 9: Neural Model Ensemble for Suggestion Mining

Samuel Pecar, Marian Simko, Maria Bielikova


Abstract
In this paper, we present neural model architecture submitted to the SemEval-2019 Task 9 competition: “Suggestion Mining from Online Reviews and Forums”. We participated in both subtasks for domain specific and also cross-domain suggestion mining. We proposed a recurrent neural network architecture that employs Bi-LSTM layers and also self-attention mechanism. Our architecture tries to encode words via word representation using ELMo and ensembles multiple models to achieve better results. We highlight importance of pre-processing of user-generated samples and its contribution to overall results. We performed experiments with different setups of our proposed model involving weighting of prediction classes for loss function. Our best model achieved in official test evaluation score of 0.6816 for subtask A and 0.6850 for subtask B. In official results, we achieved 12th and 10th place in subtasks A and B, respectively.
Anthology ID:
S19-2214
Volume:
Proceedings of the 13th International Workshop on Semantic Evaluation
Month:
June
Year:
2019
Address:
Minneapolis, Minnesota, USA
Venue:
SemEval
SIG:
SIGLEX
Publisher:
Association for Computational Linguistics
Note:
Pages:
1218–1223
Language:
URL:
https://aclanthology.org/S19-2214
DOI:
10.18653/v1/S19-2214
Bibkey:
Cite (ACL):
Samuel Pecar, Marian Simko, and Maria Bielikova. 2019. NL-FIIT at SemEval-2019 Task 9: Neural Model Ensemble for Suggestion Mining. In Proceedings of the 13th International Workshop on Semantic Evaluation, pages 1218–1223, Minneapolis, Minnesota, USA. Association for Computational Linguistics.
Cite (Informal):
NL-FIIT at SemEval-2019 Task 9: Neural Model Ensemble for Suggestion Mining (Pecar et al., SemEval 2019)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingestion-script-update/S19-2214.pdf
Code
 SamuelPecar/NL-FIIT-SemEval19-Task9