Focus on FoCus: Is FoCus focused on Context, Knowledge and Persona?
SeungYoon Lee, Jungseob Lee, Chanjun Park, Sugyeong Eo, Hyeonseok Moon, Jaehyung Seo, Jeongbae Park, Heuiseok Lim
Abstract
Rather than continuing the conversation based on personalized or implicit information, the existing conversation system generates dialogue by focusing only on the superficial content. To solve this problem, FoCus was recently released. FoCus is a persona-knowledge grounded dialogue generation dataset that leverages Wikipedia’s knowledge and personal persona, focusing on the landmarks provided by Google, enabling user-centered conversation. However, a closer empirical study is needed since research in the field is still in its early stages. Therefore, we fling two research questions about FoCus. “Is the FoCus whether for conversation or question answering?” to identify the structural problems of the dataset. “Does the FoCus model do real knowledge blending?” to closely demonstrate that the model acquires actual knowledge. As a result of the experiment, we present that the FoCus model could not correctly blend the knowledge according to the input dialogue and that the dataset design is unsuitable for the multi-turn conversation.- Anthology ID:
- 2022.ccgpk-1.1
- Volume:
- Proceedings of the 1st Workshop on Customized Chat Grounding Persona and Knowledge
- Month:
- October
- Year:
- 2022
- Address:
- Gyeongju, Republic of Korea
- Editors:
- Heuiseok Lim, Seungryong Kim, Yeonsoo Lee, Steve Lin, Paul Hongsuck Seo, Yumin Suh, Yoonna Jang, Jungwoo Lim, Yuna Hur, Suhyune Son
- Venue:
- CCGPK
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 1–8
- Language:
- URL:
- https://aclanthology.org/2022.ccgpk-1.1
- DOI:
- Cite (ACL):
- SeungYoon Lee, Jungseob Lee, Chanjun Park, Sugyeong Eo, Hyeonseok Moon, Jaehyung Seo, Jeongbae Park, and Heuiseok Lim. 2022. Focus on FoCus: Is FoCus focused on Context, Knowledge and Persona?. In Proceedings of the 1st Workshop on Customized Chat Grounding Persona and Knowledge, pages 1–8, Gyeongju, Republic of Korea. Association for Computational Linguistics.
- Cite (Informal):
- Focus on FoCus: Is FoCus focused on Context, Knowledge and Persona? (Lee et al., CCGPK 2022)
- PDF:
- https://preview.aclanthology.org/ingest-acl-2023-videos/2022.ccgpk-1.1.pdf
- Data
- FoCus