Lyrics onto Cityscape: A Mixed Reality System for Appreciating Lyrics Projected onto a Cityscape While Walking

Abstract

High-performance mobile devices have made it easy to listen to the music anytime, anywhere that matches listener's mood or to listen to the specific song at the specific place. We propose a new experience that allows people to carry visual expressions matched to the music. In this paper, we propose and develop a mixed reality system that dynamically projects the lyrics of a song users are listening to as animation of lyrics onto the cityscape where they are walking around. By using our system, the listeners will be able to appreciate visual expressions that match both the music and the landscape wherever they wish to enjoy the music.