SolomonLab at SemEval-2019 Task 8: Question Factuality and Answer Veracity Prediction in Community Forums

Ankita Gupta, Sudeep Kumar Sahoo, Divya Prakash, Rohit R.R, Vertika Srivastava, Yeon Hyang Kim

Abstract
We describe our system for SemEval-2019, Task 8 on “Fact-Checking in Community Question Answering Forums (cQA)”. cQA forums are very prevalent nowadays, as they provide an effective means for communities to share knowledge. Unfortunately, this shared information is not always factual and fact-verified. In this task, we aim to identify factual questions posted on cQA and verify the veracity of answers to these questions. Our approach relies on data augmentation and aggregates cues from several dimensions such as semantics, linguistics, syntax, writing style and evidence obtained from trusted external sources. In subtask A, our submission is ranked 3rd, with an accuracy of 83.14%. Our current best solution stands 1st on the leaderboard with 88% accuracy. In subtask B, our present solution is ranked 2nd, with 58.33% MAP score.
Anthology ID:
S19-2204
Volume:
Proceedings of the 13th International Workshop on Semantic Evaluation
Month:
June
Year:
2019
Address:
Minneapolis, Minnesota, USA
Venue:
SemEval
SIG:
SIGLEX
Publisher:
Association for Computational Linguistics
Note:
Pages:
1165–1171
Language:
URL:
https://aclanthology.org/S19-2204
DOI:
10.18653/v1/S19-2204
Bibkey:
Cite (ACL):
Ankita Gupta, Sudeep Kumar Sahoo, Divya Prakash, Rohit R.R, Vertika Srivastava, and Yeon Hyang Kim. 2019. SolomonLab at SemEval-2019 Task 8: Question Factuality and Answer Veracity Prediction in Community Forums. In Proceedings of the 13th International Workshop on Semantic Evaluation, pages 1165–1171, Minneapolis, Minnesota, USA. Association for Computational Linguistics.
Cite (Informal):
SolomonLab at SemEval-2019 Task 8: Question Factuality and Answer Veracity Prediction in Community Forums (Gupta et al., SemEval 2019)
Copy Citation:
PDF:
https://preview.aclanthology.org/paclic-22-ingestion/S19-2204.pdf
PDF Search