Show simple item record

dc.contributor.authorZhou, Shizheen_US
dc.contributor.authorWang, Zezuen_US
dc.contributor.authorYe, Dongweien_US
dc.contributor.editorHauser, Helwig and Alliez, Pierreen_US
dc.date.accessioned2023-03-22T15:07:12Z
dc.date.available2023-03-22T15:07:12Z
dc.date.issued2023
dc.identifier.issn1467-8659
dc.identifier.urihttps://doi.org/10.1111/cgf.14714
dc.identifier.urihttps://diglib.eg.org:443/handle/10.1111/cgf14714
dc.description.abstractWe propose a method for converting a single image of a transparent object into multi‐view photo that enables users observing the object from multiple new angles, without inputting any 3D shape. The complex light paths formed by refraction and reflection makes it challenging to compute the lighting effects of transparent objects from a new angle. We construct an encoder–decoder network for normal reconstruction and texture extraction, which enables synthesizing novel views of transparent object from a set of new views and new environment maps using only one RGB image. By simultaneously considering the optical transmission and perspective variation, our network learns the characteristics of optical transmission and the change of perspective as guidance to the conversion from RGB colours to surface normals. A texture extraction subnetwork is proposed to alleviate the contour loss phenomenon during normal map generation. We test our method using 3D objects within and without our training data, including real 3D objects that exists in our lab, and completely new environment maps that we take using our phones. The results show that our method performs better on view synthesis of transparent objects in complex scenes using only a single‐view image.en_US
dc.publisherEurographics ‐ The European Association for Computer Graphics and John Wiley & Sons Ltd.en_US
dc.subjectimage and video processing
dc.subjectview independent and 3D video
dc.subjectrendering
dc.subjecttexture synthesis
dc.titleNovel View Synthesis Of Transparent Object From a Single Imageen_US
dc.description.seriesinformationComputer Graphics Forum
dc.description.sectionheadersArticles
dc.description.volume42
dc.description.number1
dc.identifier.doi10.1111/cgf.14714
dc.identifier.pages21-32


Files in this item

Thumbnail

This item appears in the following Collection(s)

Show simple item record