Harnessing the Human Visual System for Image Based Modeling: an Interaction System

Abstract

We present a novel interaction system for modeling 3D geometry from photographs. Given a set of stereo pairs, along with their camera parameters, the interface tracks the movements of the users and allows them to intuitively position the modeling tools in 3D and to browse the stereo pairs using head movements. The geometry being modeled is overlaid on the photographs using a stereo display. The use of the known camera parameters for displaying the geometry ensures proper registration with each photograph and thus results in correct 3D models.