Skimming Video Action Using Annotated 3D Surfaces

Abstract

It has become all too clear that despite the ever-growing reams of available media, we face diminishing strategic returns from it unless we craft better tools that not only let us playback media but also get us quickly to media segments of most interest. Witness the everyday frustration of false positives when watching user-generated video content that, with appropriate insight, the user might have otherwise chosen not to watch. In this paper we describe a new and dramatically different new way to both summarize and interact with multimedia information in rapid, 3D, user-in-the-loop, skimming sessions. Our new interaction technique, which can accommodate object recognition algorithms, is a fusion of media summarization and 3D scene generation techniques and runs on mobile, tablet and desktops.