Visual Perception in Realistic Image Synthesis

Abstract

Realism is often a primary goal in computer graphics imagery, we strive to create images that are perceptually indistinguishable from an actual scene. Rendering systems can now closely approximate the physical distribution of light in an environment. However, physical accuracy does not guarantee that the displayed images will have authentic visual appearance. In recent years the emphasis in realistic image synthesis has begun to shift from the simulation of light in an environment to images that look as real as the physical environment they portray. In other words the computer image should be not only physically correct but also perceptually equivalent to the scene it represents. This implies aspects of the Human Visual System (HVS) must be considered if realism is required. Visual perception is employed in many different guises in graphics to achieve authenticity. Certain aspects of the human visual system must be considered to identify the perceptual effects that a realistic rendering system must achieve in order to effectively reproduce a similar visual response to a real scene. This state-of-the-art report outlines the manner in which knowledge about visual perception is increasingly appearing in state-of-the-art realistic image synthesis. This STAR is organised into three sections, each exploring the use of perception in realistic image synthesis, each with slightly different emphasis and application. First, perception driven rendering algorithms are described, these algorithms focus on embedding models of the Human Visual System (HVS) directly into global illumination computations in order to improve their efficiency. Then perception based image quality metrics, which aim to compare images on a perceptual rather than physical basis are presented. These metrics can be used to evaluate, validate and compare imagery. Finally, Tone Reproduction Operators, which attempt to map the vast range of computed radiance values to the limited range of display values, are discussed.