VarIS: Variable Illumination Sphere for Facial Capture, Model Scanning, and Spatially Varying Appearance Acquisition
View/ Open
Date
2023Author
Baron, Jessica
Li, Xiang
Joshi, Parisha
Itty, Nathaniel
Greene, Sarah
Dhillon, Daljit Singh J.
Patterson, Eric
Metadata
Show full item recordAbstract
We introduce VarIS, our Variable Illumination Sphere – a multi-purpose system for acquiring and processing real-world geometric and appearance data for computer-graphics research and production. Its key applications among many are (1) human-face capture, (2) model scanning, and (3) spatially varying material acquisition. Facial capture requires high-resolution cameras at multiple viewpoints, photometric capabilities, and a swift process due to human movement. Acquiring a digital version of a physical model is somewhat similar but with different constraints for image processing and more allowable time. Each requires detailed estimations of geometry and physically based shading properties. Measuring spatially varying light-scattering properties requires spanning four dimensions of illumination and viewpoint with angular, spatial, and spectral accuracy, and this process can also be assisted using multiple, simultaneous viewpoints or rapid switching of lights with no movement necessary. VarIS is a system of hardware and software for spherical illumination and imaging that has been custom designed and developed by our team. It has been inspired by Light Stages and goniophotometers, but costs less through use of primarily off-the-shelf components, and additionally extends capabilities beyond these devices. In this paper we describe the unique system and contributions, including practical details that could assist other researchers and practitioners.
BibTeX
@inproceedings {10.2312:stag.20231292,
booktitle = {Smart Tools and Applications in Graphics - Eurographics Italian Chapter Conference},
editor = {Banterle, Francesco and Caggianese, Giuseppe and Capece, Nicola and Erra, Ugo and Lupinetti, Katia and Manfredi, Gilda},
title = {{VarIS: Variable Illumination Sphere for Facial Capture, Model Scanning, and Spatially Varying Appearance Acquisition}},
author = {Baron, Jessica and Li, Xiang and Joshi, Parisha and Itty, Nathaniel and Greene, Sarah and Dhillon, Daljit Singh J. and Patterson, Eric},
year = {2023},
publisher = {The Eurographics Association},
ISSN = {2617-4855},
ISBN = {978-3-03868-235-6},
DOI = {10.2312/stag.20231292}
}
booktitle = {Smart Tools and Applications in Graphics - Eurographics Italian Chapter Conference},
editor = {Banterle, Francesco and Caggianese, Giuseppe and Capece, Nicola and Erra, Ugo and Lupinetti, Katia and Manfredi, Gilda},
title = {{VarIS: Variable Illumination Sphere for Facial Capture, Model Scanning, and Spatially Varying Appearance Acquisition}},
author = {Baron, Jessica and Li, Xiang and Joshi, Parisha and Itty, Nathaniel and Greene, Sarah and Dhillon, Daljit Singh J. and Patterson, Eric},
year = {2023},
publisher = {The Eurographics Association},
ISSN = {2617-4855},
ISBN = {978-3-03868-235-6},
DOI = {10.2312/stag.20231292}
}
Except where otherwise noted, this item's license is described as Attribution 4.0 International License
Related items
Showing items related by title, author, creator and subject.
-
NeuroDog: Quadruped Embodiment using Neural Networks
Egan, Dónal; Cosker, Darren; McDonnell, Rachel (ACM Association for Computing Machinery, 2023)Virtual reality (VR) allows us to immerse ourselves in alternative worlds in which we can embody avatars to take on new identities. Usually, these avatars are humanoid or possess very strong anthropomorphic qualities. ... -
Style Invariant Locomotion Classification for Character Control
Boehs, G.E.; Vieira, M.L.H. (© 2019 The Eurographics Association and John Wiley & Sons Ltd., 2019)We present a real‐time system for character control that relies on the classification of locomotive actions in skeletal motion capture data. Our method is both progress dependent and style invariant. Two deep neural networks ... -
Data-Driven Face Analysis for Performance Retargeting
Zoss, Gaspard (ETH Zurich, 2022-05-25)The democratization of digital humans in entertainment was made possible by the recent advances in performance capture, rendering and animation techniques. The human face, which is key to realism, is very complex to animate ...