3D-centered Media Linking and Semantic Enrichment through Integrated Searching, Browsing, Viewing and Annotating

Abstract

The digitally documented world heritage is archived in databases or repositories, where collections of metadata, images, multimedia objects or nowadays even digital 3D artifacts can be stored and queried. Modeling and linking all this information is complex and involves refined categorizations and relations, which are usually accessed by either simplistic or overwhelmingly complex interfaces. Hence, finding the right level of abstraction for a general interface is very challenging. This becomes even more demanding, if in addition to collection exploration, semantic enrichment is required. This work focuses on the design and implementation of an integrated interface, in which four dedicated activities are combined and provided: i) flexible definition of relational queries, ii) browsing of multiple results and query refinement, iii) inspection and analysis of multimedia objects, and iv) building and enrichment of semantic relationships (data paths) between objects. This integrated interface can handle different kinds of multimedia objects, allowing for querying and annotating text, 2D images or 3D artifacts. We present the software design of this interface and the corresponding underlying model in the semantic network. This work is a general step toward interfacing to 3D Linked Open Data.