"Did You Hear That?" Playing Video Games from Audio Cues with Raluca D. Gaina
Game-playing AI research has focused for a long time on learning to play video games from visual input or symbolic information. However, humans benefit from a wider array of sensors which we utilise in order to navigate the world around us. In particular, sounds and music are key to how many of us perceive the world and influence the decisions we make. This talk motivates and encourages this research area, and presents initial experiments on game-playing agents learning to play video games solely from audio cues.
Based on short paper accepted at IEEE CoG 2019: https://arxiv.org/abs/1906.04027