TueFact at SemEval 2019 Task 8: Fact checking in community question answering forums: context matters

Réka Juhász, Franziska Barbara Linnenschmidt, Teslin Roys


Abstract
The SemEval 2019 Task 8 on Fact-Checking in community question answering forums aimed to classify questions into categories and verify the correctness of answers given on the QatarLiving public forum. The task was divided into two subtasks: the first classifying the question, the second the answers. The TueFact system described in this paper used different approaches for the two subtasks. Subtask A makes use of word vectors based on a bag-of-word-ngram model using up to trigrams. Predictions are done using multi-class logistic regression. The official SemEval result lists an accuracy of 0.60. Subtask B uses vectorized character n-grams up to trigrams instead. Predictions are done using a LSTM model and achieved an accuracy of 0.53 on the final SemEval Task 8 evaluation set.
Anthology ID:
S19-2206
Volume:
Proceedings of the 13th International Workshop on Semantic Evaluation
Month:
June
Year:
2019
Address:
Minneapolis, Minnesota, USA
Editors:
Jonathan May, Ekaterina Shutova, Aurelie Herbelot, Xiaodan Zhu, Marianna Apidianaki, Saif M. Mohammad
Venue:
SemEval
SIG:
SIGLEX
Publisher:
Association for Computational Linguistics
Note:
Pages:
1176–1179
Language:
URL:
https://aclanthology.org/S19-2206
DOI:
10.18653/v1/S19-2206
Bibkey:
Cite (ACL):
Réka Juhász, Franziska Barbara Linnenschmidt, and Teslin Roys. 2019. TueFact at SemEval 2019 Task 8: Fact checking in community question answering forums: context matters. In Proceedings of the 13th International Workshop on Semantic Evaluation, pages 1176–1179, Minneapolis, Minnesota, USA. Association for Computational Linguistics.
Cite (Informal):
TueFact at SemEval 2019 Task 8: Fact checking in community question answering forums: context matters (Juhász et al., SemEval 2019)
Copy Citation:
PDF:
https://preview.aclanthology.org/nschneid-patch-1/S19-2206.pdf