Interactive Reinforcement Learning for Table Balancing Robot

Haein Jeon, Yewon Kim, Bo-Yeong Kang


Abstract
With the development of robotics, the use of robots in daily life is increasing, which has led to the need for anyone to easily train robots to improve robot use. Interactive reinforcement learning(IARL) is a method for robot training based on human–robot interaction; prior studies on IARL provide only limited types of feedback or require appropriately designed shaping rewards, which is known to be difficult and time-consuming. Therefore, in this study, we propose interactive deep reinforcement learning models based on voice feedback. In the proposed system, a robot learns the task of cooperative table balancing through deep Q-network using voice feedback provided by humans in real-time, with automatic speech recognition(ASR) and sentiment analysis to understand human voice feedback. As a result, an optimal policy convergence rate of up to 96% was realized, and performance was improved in all voice feedback-based models
Anthology ID:
2021.splurobonlp-1.8
Volume:
Proceedings of Second International Combined Workshop on Spatial Language Understanding and Grounded Communication for Robotics
Month:
August
Year:
2021
Address:
Online
Editors:
Malihe Alikhani, Valts Blukis, Parisa Kordjamshidi, Aishwarya Padmakumar, Hao Tan
Venue:
splurobonlp
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
71–78
Language:
URL:
https://aclanthology.org/2021.splurobonlp-1.8
DOI:
10.18653/v1/2021.splurobonlp-1.8
Bibkey:
Cite (ACL):
Haein Jeon, Yewon Kim, and Bo-Yeong Kang. 2021. Interactive Reinforcement Learning for Table Balancing Robot. In Proceedings of Second International Combined Workshop on Spatial Language Understanding and Grounded Communication for Robotics, pages 71–78, Online. Association for Computational Linguistics.
Cite (Informal):
Interactive Reinforcement Learning for Table Balancing Robot (Jeon et al., splurobonlp 2021)
Copy Citation:
PDF:
https://preview.aclanthology.org/emnlp22-frontmatter/2021.splurobonlp-1.8.pdf