Audio Resynthesis on the Dancefloor: A Music Structural Approach

Abstract

We propose a method for synthesizing a novel soundtrack from an existing musical piece while preserving its structure and continuity from a music theoretical point of view. Existing approaches analyze a musical piece for possible cut points that allow the resynthesis of a novel soundtrack by lining up the source segments according to specified rules but fail to maintain musically correct song progression. Introducing the alignment of rhythmic and harmonic structures during transition point detection, we employ beat tracking as the analysis core component and take the human sound perception into account. Automatic segment rearrangement is improved by employing a novel belief propagation approach that enables user-defined constraints for the output soundtrack, allowing video editors or dance choreographers to tailor a soundtrack to their specific demands.