Audio Commentary System for Real-Time Racing Game Play

Tatsuya Ishigaki, Goran Topić, Yumi Hamazono, Ichiro Kobayashi, Yusuke Miyao, Hiroya Takamura


Abstract
Live commentaries are essential for enhancing spectators’ enjoyment and understanding during sports events or e-sports streams. We introduce a live audio commentator system designed specifically for a racing game, driven by the high demand in the e-sports field. While a player is playing a racing game, our system tracks real-time user play data including speed and steer rotations, and generates commentary to accompany the live stream. Human evaluation suggested that generated commentary enhances enjoyment and understanding of races compared to streams without commentary. Incorporating additional modules to improve diversity and detect irregular events, such as course-outs and collisions, further increases the preference for the output commentaries.
Anthology ID:
2023.inlg-demos.4
Volume:
Proceedings of the 16th International Natural Language Generation Conference: System Demonstrations
Month:
September
Year:
2023
Address:
Prague, Czechia
Editors:
C. Maria Keet, Hung-Yi Lee, Sina Zarrieß
Venues:
INLG | SIGDIAL
SIG:
SIGGEN
Publisher:
Association for Computational Linguistics
Note:
Pages:
9–10
Language:
URL:
https://aclanthology.org/2023.inlg-demos.4
DOI:
Bibkey:
Cite (ACL):
Tatsuya Ishigaki, Goran Topić, Yumi Hamazono, Ichiro Kobayashi, Yusuke Miyao, and Hiroya Takamura. 2023. Audio Commentary System for Real-Time Racing Game Play. In Proceedings of the 16th International Natural Language Generation Conference: System Demonstrations, pages 9–10, Prague, Czechia. Association for Computational Linguistics.
Cite (Informal):
Audio Commentary System for Real-Time Racing Game Play (Ishigaki et al., INLG-SIGDIAL 2023)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-acl-2023-videos/2023.inlg-demos.4.pdf