Unified Skeletal Animation Reconstruction with Multiple Kinects

Abstract

We present a new method for reconstructing a unified skeletal animation with multiple Kinects. Our method is able to reconstruct the unified skeletal animation from Kinect data over 360 degrees. We make use of all three streams: RGB, depth and skeleton, along with the joint tracking confidence state from Microsoft Kinect SDK to find the correctly oriented skeletons and merge them together to get a uniform animation. Our method is easy to implement and provides a simple solution of creating a 360 degree plausible unified skeletal animation that would not be possible to capture with a single Kinect due to occlusions, tracking failures, and field of view constraints.