An Interface to Explore Personal Memories

Abstract

Query definition and automatic annotation are key issues when searching for images and videos. Due to the richness of the visual information different types of queries (e.g., image examples, keywords ar sketches) are required and consequently, automatic annotation of images with keywords ar with visual features must be provided. This paper describes a user inte1face designed to explore personal memories composed by pictures and videos. The application pro vides the following operations: capture, annotation, visualization and search for media items in a multimedia database. psers can query the media collection in severa/ ways and for this reason a visual language to define queries is proposed. Queries are defined by drag and drop of visual items and operators to a query box. Automatic annotation is also performed using the image content and the audio information obtained when users show their images to others. Experimental results are presented to illustrate the ejfectiveness of the application.