Abstract
This paper describes our system for verifying statements with tables at SemEval-2021 Task 9. We developed a two-stage verifying system based on the latest table-based pre-trained model GraPPa. Multiple networks are devised to verify different types of statements in the competition dataset and an adaptive model ensembling technique is applied to ensemble models in both stages. A statement-slot-based symbolic operation module is also used in our system to further improve the performance and stability of the system. Our model achieves second place in the 3-way classification and fourth place in the 2-way classification evaluation. Several ablation experiments show the effectiveness of different modules proposed in this paper.- Anthology ID:
- 2021.semeval-1.50
- Volume:
- Proceedings of the 15th International Workshop on Semantic Evaluation (SemEval-2021)
- Month:
- August
- Year:
- 2021
- Address:
- Online
- Venue:
- SemEval
- SIG:
- SIGLEX
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 416–422
- Language:
- URL:
- https://aclanthology.org/2021.semeval-1.50
- DOI:
- 10.18653/v1/2021.semeval-1.50
- Cite (ACL):
- Yuxuan Zhou, Kaiyin Zhou, Xien Liu, Ji Wu, and Xiaodan Zhu. 2021. THiFly_Queens at SemEval-2021 Task 9: Two-stage Statement Verification with Adaptive Ensembling and Slot-based Operation. In Proceedings of the 15th International Workshop on Semantic Evaluation (SemEval-2021), pages 416–422, Online. Association for Computational Linguistics.
- Cite (Informal):
- THiFly_Queens at SemEval-2021 Task 9: Two-stage Statement Verification with Adaptive Ensembling and Slot-based Operation (Zhou et al., SemEval 2021)
- PDF:
- https://preview.aclanthology.org/paclic-22-ingestion/2021.semeval-1.50.pdf