Dawei Feng
2021
Diversity and Consistency: Exploring Visual Question-Answer Pair Generation
Sen Yang
|
Qingyu Zhou
|
Dawei Feng
|
Yang Liu
|
Chao Li
|
Yunbo Cao
|
Dongsheng Li
Findings of the Association for Computational Linguistics: EMNLP 2021
Although showing promising values to downstream applications, generating question and answer together is under-explored. In this paper, we introduce a novel task that targets question-answer pair generation from visual images. It requires not only generating diverse question-answer pairs but also keeping the consistency of them. We study different generation paradigms for this task and propose three models: the pipeline model, the joint model, and the sequential model. We integrate variational inference into these models to achieve diversity and consistency. We also propose region representation scaling and attention alignment to improve the consistency further. We finally devise an evaluator as a quantitative metric for consistency. We validate our approach on two benchmarks, VQA2.0 and Visual-7w, by automatically and manually evaluating diversity and consistency. Experimental results show the effectiveness of our models: they can generate diverse or consistent pairs. Moreover, this task can be used to improve visual question generation and visual question answering.
2019
Exploring Pre-trained Language Models for Event Extraction and Generation
Sen Yang
|
Dawei Feng
|
Linbo Qiao
|
Zhigang Kan
|
Dongsheng Li
Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics
Traditional approaches to the task of ACE event extraction usually depend on manually annotated data, which is often laborious to create and limited in size. Therefore, in addition to the difficulty of event extraction itself, insufficient training data hinders the learning process as well. To promote event extraction, we first propose an event extraction model to overcome the roles overlap problem by separating the argument prediction in terms of roles. Moreover, to address the problem of insufficient training data, we propose a method to automatically generate labeled data by editing prototypes and screen out generated samples by ranking the quality. Experiments on the ACE2005 dataset demonstrate that our extraction model can surpass most existing extraction methods. Besides, incorporating our generation method exhibits further significant improvement. It obtains new state-of-the-art results on the event extraction task, including pushing the F1 score of trigger classification to 81.1%, and the F1 score of argument classification to 58.9%.
Search
Co-authors
- Sen Yang 2
- Dongsheng Li 2
- Qingyu Zhou 1
- Yang Liu 1
- Chao Li 1
- show all...