thumbnail

SPIDER: Spherical Indoor Depth Renderer

Muhammad Tukur, Giovanni Pintore, Enrico Gobbetti, Jens Schneider, and Marco Agus

October 2022

Abstract

Today's Extended Reality (XR) applications that call for specific Diminished Reality (DR) strategies to hide specific classes of objects are increasingly using 360◦ cameras, which can capture entire areas in a single picture. In this work, we present an interactive-based image editing and rendering system named SPIDER, that takes a spherical 360◦ indoor scene as input. The system incorporates the output of deep learning models to abstract the segmentation and depth images of full and empty rooms to allow users to perform interactive exploration and basic editing operations on the reconstructed indoor scene, namely: i) rendering of the scene in various modalities (point cloud, polygonal, wireframe) ii) refurnishing (transferring portions of rooms) iii) deferred shading through the usage of recomputed normal maps. These kinds of scene editing and manipulations can be used for assessing the inference from deep learning models and enable several Mixed Reality (XR) applications in areas such as furniture retails, interior designs, and real estates. Moreover, it can also be useful in data augmentation, arts, designs, and paintings.

Reference and download information

Muhammad Tukur, Giovanni Pintore, Enrico Gobbetti, Jens Schneider, and Marco Agus. SPIDER: Spherical Indoor Depth Renderer. In Proc. Smart Tools and Applications in Graphics (STAG). Pages 131-138, October 2022. DOI: 10.2312/stag.20221267.

Related multimedia productions

Bibtex citation record

@inproceedings{Tukur:2022:SSI,
    author = {Muhammad Tukur and Giovanni Pintore and Enrico Gobbetti and Jens Schneider and Marco Agus},
    title = {{SPIDER}: Spherical Indoor Depth Renderer},
    booktitle = {Proc. Smart Tools and Applications in Graphics (STAG)},
    pages = {131--138},
    month = {October},
    year = {2022},
    abstract = { Today's Extended Reality (XR) applications that call for specific Diminished Reality (DR) strategies to hide specific classes of objects are increasingly using 360◦ cameras, which can capture entire areas in a single picture. In this work, we present an interactive-based image editing and rendering system named SPIDER, that takes a spherical 360◦ indoor scene as input. The system incorporates the output of deep learning models to abstract the segmentation and depth images of full and empty rooms to allow users to perform interactive exploration and basic editing operations on the reconstructed indoor scene, namely: i) rendering of the scene in various modalities (point cloud, polygonal, wireframe) ii) refurnishing (transferring portions of rooms) iii) deferred shading through the usage of recomputed normal maps. These kinds of scene editing and manipulations can be used for assessing the inference from deep learning models and enable several Mixed Reality (XR) applications in areas such as furniture retails, interior designs, and real estates. Moreover, it can also be useful in data augmentation, arts, designs, and paintings. },
    doi = {10.2312/stag.20221267},
    url = {http://vic.crs4.it/vic/cgi-bin/bib-page.cgi?id='Tukur:2022:SSI'},
}