Rendering Interior Cultural Heritage Scenes Using Image-based Shooting

Abstract

Rendering interior cultural heritage scenes using physically based rendering with outdoor environment maps is computationally expensive using ray tracing methods, and currently difficult for interactive applications without significant precomputation of lighting. In this paper, we present a novel approach to relight synthetic interior scenes by extending image-based lighting to generate fast high-quality interactive previews of these environments. Interior light probes are acquired from a real scene, then used to shoot light onto the virtual scene geometry to accelerate image synthesis by assuming the light sources shot act as the correct solution of light transport for that particular intersection point. We term this approach Image-Based Shooting. It is demonstrated in this paper with an approach inspired by Irradiance Cache Splatting. The methodology is well-suited for interior scenes in which light enters through narrow windows and doors, common at cultural heritage sites. Our implementation generates high-quality interactive preview renditions of these sites and can significantly aid documentation, 3D model validation and predictive rendering. The method can easily be integrated with existing cultural heritage reconstruction pipelines, especially ray tracing based renderers.