3D GrabCut: Interactive Foreground Extraction for Reconstructed 3D Scenes

Abstract

In the near future, mobile devices will be able to measure the 3D geometry of an environment using integrated depth sensing technology. This technology will enable anyone to reconstruct a 3D model of their surroundings. Similar to natural 2D images, a 3D model of a natural scene will occasionally contain a desired foreground object and an unwanted background region. Inspired by GrabCut for still images, we propose a system to perform interactive foreground/background segmentation on a reconstructed 3D scene using an intuitive user interface. Our system is designed to enable anyone, regardless of skill, to extract a 3D object from a 3D scene with a minimal amount of effort. The only input required by the user is a rectangular box around the desired object. We performed several experiments to demonstrate that our system produces high-quality segmentation on a wide variety of 3D scenes.