Abstract
The paper presents the results of the Shared Task hosted by the Second DialDoc Workshop on Document-grounded Dialogue and Conversational Question Answering co-located at ACL 2022. The primary goal of this Shared Task is to build goal-oriented information-seeking conversation systems that are grounded in the domain documents, where each dialogue could correspond to multiple subtasks that are based on different documents. The task is to generate agent responses in natural language given the dialogue and document contexts. There are two task settings and leaderboards based on (1) the same sets of domains (SEEN) and (2) one unseen domain (UNSEEN). There are over 20 teams participating in Dev Phase and 8 teams participating in both Dev and Test Phases. Multiple submissions significantly outperform the baseline. The best-performing system achieves 52.06 F1 and the total of 191.30 on the SEEN task; and 34.65 F1 and the total of 130.79 on the UNSEEN task.- Anthology ID:
- 2022.dialdoc-1.18
- Volume:
- Proceedings of the Second DialDoc Workshop on Document-grounded Dialogue and Conversational Question Answering
- Month:
- May
- Year:
- 2022
- Address:
- Dublin, Ireland
- Venue:
- dialdoc
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 155–160
- Language:
- URL:
- https://aclanthology.org/2022.dialdoc-1.18
- DOI:
- 10.18653/v1/2022.dialdoc-1.18
- Cite (ACL):
- Song Feng, Siva Patel, and Hui Wan. 2022. DialDoc 2022 Shared Task: Open-Book Document-grounded Dialogue Modeling. In Proceedings of the Second DialDoc Workshop on Document-grounded Dialogue and Conversational Question Answering, pages 155–160, Dublin, Ireland. Association for Computational Linguistics.
- Cite (Informal):
- DialDoc 2022 Shared Task: Open-Book Document-grounded Dialogue Modeling (Feng et al., dialdoc 2022)
- PDF:
- https://preview.aclanthology.org/auto-file-uploads/2022.dialdoc-1.18.pdf
- Data
- Doc2Dial, MultiDoc2Dial, doc2dial