High quality images from 2.5D video

Abstract

Given a 2D video stream with an accompanying depth channel, we render high quality images from viewpoints close to the original one. This is for instance required to generate a 3D impression on stereoscopic or multiview screens. We propose a technique for video based rendering that supports higher order video filtering. We focus on screens that support horizontal parallax. We can optionally incorporate rendering of a so called hidden layer that contains data of parts of the scene that are hidden from the original viewpoint. We are able to render high quality images at only the added cost of the video filtering.