PicTalky: Augmentative and Alternative Communication for Language Developmental Disabilities
Chanjun Park, Yoonna Jang, Seolhwa Lee, Jaehyung Seo, Kisu Yang, Heuiseok Lim
Abstract
Children with language disabilities face communication difficulties in daily life. They are often deprived of the opportunity to participate in social activities due to their difficulty in understanding or using natural language. In this regard, Augmentative and Alternative Communication (AAC) can be a practical means of communication for children with language disabilities. In this study, we propose PicTalky, which is an AI-based AAC system that helps children with language developmental disabilities to improve their communication skills and language comprehension abilities. PicTalky can process both text and pictograms more accurately by connecting a series of neural-based NLP modules. Additionally, we perform quantitative and qualitative analyses on the modules of PicTalky. By using this service, it is expected that those suffering from language problems will be able to express their intentions or desires more easily and improve their quality of life. We have made the models freely available alongside a demonstration of the web interface. Furthermore, we implemented robotics AAC for the first time by applying PicTalky to the NAO robot.- Anthology ID:
- 2022.aacl-demo.3
- Volume:
- Proceedings of the 2nd Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics and the 12th International Joint Conference on Natural Language Processing: System Demonstrations
- Month:
- November
- Year:
- 2022
- Address:
- Taipei, Taiwan
- Editors:
- Wray Buntine, Maria Liakata
- Venues:
- AACL | IJCNLP
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 17–27
- Language:
- URL:
- https://aclanthology.org/2022.aacl-demo.3
- DOI:
- Cite (ACL):
- Chanjun Park, Yoonna Jang, Seolhwa Lee, Jaehyung Seo, Kisu Yang, and Heuiseok Lim. 2022. PicTalky: Augmentative and Alternative Communication for Language Developmental Disabilities. In Proceedings of the 2nd Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics and the 12th International Joint Conference on Natural Language Processing: System Demonstrations, pages 17–27, Taipei, Taiwan. Association for Computational Linguistics.
- Cite (Informal):
- PicTalky: Augmentative and Alternative Communication for Language Developmental Disabilities (Park et al., AACL-IJCNLP 2022)
- PDF:
- https://preview.aclanthology.org/nschneid-patch-1/2022.aacl-demo.3.pdf