Show simple item record

dc.contributor.authorRückert, Dariusen_US
dc.contributor.authorStamminger, Marcen_US
dc.contributor.editorAndres, Bjoern and Campen, Marcel and Sedlmair, Michaelen_US
dc.date.accessioned2021-09-25T16:36:28Z
dc.date.available2021-09-25T16:36:28Z
dc.date.issued2021
dc.identifier.isbn978-3-03868-161-8
dc.identifier.urihttps://doi.org/10.2312/vmv.20211375
dc.identifier.urihttps://diglib.eg.org:443/handle/10.2312/vmv20211375
dc.description.abstractTraining and inference of convolutional neural networks (CNNs) on truncated signed distance fields (TSDFs) is a challenging task. Large parts of the scene are usually empty, which makes dense implementations inefficient in terms of memory consumption and compute throughput. However, due to the truncation distance, non-zero values are grouped around the surface creating small dense blocks inside the large empty space. We show that this structure can be exploited by storing the TSDF in a block sparse tensor and then decomposing it into rectilinear super blocks. A super block is a dense 3d cuboid of variable size and can be processed by conventional CNNs. We analyze the rectilinear decomposition and present a formulation for computing the bandwidth-optimal solution given a specific network architecture. However, this solution is NP-complete, therefore we also a present a heuristic approach for fast training and inference tasks. We verify the effectiveness of SuBloNet and report a speedup of 4x towards dense implementations and 1.7x towards state-of-the-art sparse implementations. Using the super block architecture, we show that recurrent volumetric fusion is now possible on large scale scenes. Such a systems is able to reconstruct high-quality surfaces from few noisy depth images.en_US
dc.publisherThe Eurographics Associationen_US
dc.subjectComputing methodologies
dc.subjectReconstruction
dc.subjectMixed / augmented reality
dc.subject3D imaging
dc.titleSuBloNet: Sparse Super Block Networks for Large Scale Volumetric Fusionen_US
dc.description.seriesinformationVision, Modeling, and Visualization
dc.description.sectionheadersCapturing and Rendering
dc.identifier.doi10.2312/vmv.20211375
dc.identifier.pages91-98


Files in this item

Thumbnail

This item appears in the following Collection(s)

Show simple item record