Recent Trends in 3D Reconstruction of General Non-Rigid Scenes
View/ Open
Date
2024Author
Yunus, Raza
Lenssen, Jan Eric
Niemeyer, Michael
Liao, Yiyi
Rupprecht, Christian
Theobalt, Christian
Pons-Moll, Gerard
Huang, Jia-Bin
Golyanik, Vladislav
Ilg, Eddy
Metadata
Show full item recordAbstract
Reconstructing models of the real world, including 3D geometry, appearance, and motion of real scenes, is essential for computer graphics and computer vision. It enables the synthesizing of photorealistic novel views, useful for the movie industry and AR/VR applications. It also facilitates the content creation necessary in computer games and AR/VR by avoiding laborious manual design processes. Further, such models are fundamental for intelligent computing systems that need to interpret real-world scenes and actions to act and interact safely with the human world. Notably, the world surrounding us is dynamic, and reconstructing models of dynamic, non-rigidly moving scenes is a severely underconstrained and challenging problem. This state-of-the-art report (STAR) offers the reader a comprehensive summary of state-of-the-art techniques with monocular and multi-view inputs such as data from RGB and RGB-D sensors, among others, conveying an understanding of different approaches, their potential applications, and promising further research directions. The report covers 3D reconstruction of general non-rigid scenes and further addresses the techniques for scene decomposition, editing and controlling, and generalizable and generative modeling. More specifically, we first review the common and fundamental concepts necessary to understand and navigate the field and then discuss the state-of-the-art techniques by reviewing recent approaches that use traditional and machine-learning-based neural representations, including a discussion on the newly enabled applications. The STAR is concluded with a discussion of the remaining limitations and open challenges.
BibTeX
@article {10.1111:cgf.15062,
journal = {Computer Graphics Forum},
title = {{Recent Trends in 3D Reconstruction of General Non-Rigid Scenes}},
author = {Yunus, Raza and Lenssen, Jan Eric and Niemeyer, Michael and Liao, Yiyi and Rupprecht, Christian and Theobalt, Christian and Pons-Moll, Gerard and Huang, Jia-Bin and Golyanik, Vladislav and Ilg, Eddy},
year = {2024},
publisher = {The Eurographics Association and John Wiley & Sons Ltd.},
ISSN = {1467-8659},
DOI = {10.1111/cgf.15062}
}
journal = {Computer Graphics Forum},
title = {{Recent Trends in 3D Reconstruction of General Non-Rigid Scenes}},
author = {Yunus, Raza and Lenssen, Jan Eric and Niemeyer, Michael and Liao, Yiyi and Rupprecht, Christian and Theobalt, Christian and Pons-Moll, Gerard and Huang, Jia-Bin and Golyanik, Vladislav and Ilg, Eddy},
year = {2024},
publisher = {The Eurographics Association and John Wiley & Sons Ltd.},
ISSN = {1467-8659},
DOI = {10.1111/cgf.15062}
}
Collections
Except where otherwise noted, this item's license is described as Attribution 4.0 International License
Related items
Showing items related by title, author, creator and subject.
-
Outside-in Priority-based Approximation of 3D Models in LEGO Bricks
Fanni, Filippo Andrea; Rossi, Elisa De; Giachetti, Andrea (The Eurographics Association, 2022)In this paper, we discuss the problem of converting a 3D mesh into an assembly of LEGO blocks. The major challenge of this task is how to aggregate the voxels derived by the shape discretization into a set of standard ... -
A Survey of Urban Reconstruction
Musialski, P.; Wonka, P.; Aliaga, D. G.; Wimmer, M.; Gool, L.; Purgathofer, W. (The Eurographics Association and Blackwell Publishing Ltd., 2013)This paper provides a comprehensive overview of urban reconstruction. While there exists a considerable body of literature, this topic is still under active research. The work reviewed in this survey stems from the following ... -
Rational Bézier Guarding
Khanteimouri, Payam; Mandad, Manish; Campen, Marcel (The Eurographics Association and John Wiley & Sons Ltd., 2022)We present a reliable method to generate planar meshes of nonlinear rational triangular elements. The elements are guaranteed to be valid, i.e. defined by injective rational functions. The mesh is guaranteed to conform ...