EVOCATION: Advanced Visual and Geometric Computing for 3D Capture, Display, and Fabrication

Details
Funded by: EU H2020	Reference: H2020-MSCA-ITN-813170
Start: 2018-10-01	Duration: 48 months+6 months extension
Partners
Coordinator: University of Rostock	Germany
Contractor: CRS4	Italy
Contractor: University of Zurich	Switzerland
Contractor: ISTI-CNR	Italy
Contractor: Holografika	Hungary
Contractor: TU Wien	Austria
Contractor: Fraunhofer IGD	Germany
Contractor: Gexcel	Italy

Abstract

EVOCATION is a leading European-wide doctoral Collegium focusing on scalable and high-fidelity shape and appearance acquisition, extraction of structure and semantic information, processing, visualization, 3D display and 3D fabrication in professional and consumer applications. The EVOCATION network of public and private entities is naturally multidisciplinary and multi-institutional and will: (a) advance the state-of-the-art in geometry and material acquisition, geometry processing and semantic feature extraction, interactive visualization, computational fabrication, as well as high-bandwidth / 3D display systems; (b) bridge complementary approaches for cost-effective data digitization, visualization, fabrication, and display through the integration of different methodologies in the 3D capture, processing and fabrication pipeline; (c) promote, through domain-specific challenges, multidisciplinary research applied to concrete problems of the real world, in strict cooperation with end users in engineering, science and humanities; (d) demonstrate the feasibility and efficiency of scalable cost-effective end-to-end techniques to virtually and physically capture and create objects with complex shape and appearance; (e) increase awareness of the benefits of advanced visual and geometric computing technology in both professional and consumer domains. The network will host 14 ESRs distributed among 6 public institutions and 2 companies across Europe. The ESRs will receive scientific skills in cutting-edge techniques in a highly stimulating and collaborative international environment. Further information on the EVOCATION network is available at www.evocation.eu CRS4 co-leads the project with University of Rostock and performs research in the areas of 3D reconstruction and real-time rendering.

Publications

	[1] Giovanni Pintore, Eva Almansa, Armando Sanchez, Giorgio Vassena, and Enrico Gobbetti. Deep Panoramic Depth Prediction and Completion for Indoor Scenes. Computational Visual Media, February 2024. DOI: 10.1007/s41095-023-0358-0.
	[2] Eva Almansa. Data-driven depth and 3D architectural layout estimation of an interior environment from monocular panoramic input. PhD thesis. PhD Programme in Mathematics and Computer Science, University of Cagliari, Italy, 2024.
	[3] Muhammad Tukur, Giovanni Pintore, Enrico Gobbetti, Jens Schneider, and Marco Agus. SPIDER: A framework for processing, editing and presenting immersive high-resolution spherical indoor scenes. Graphical Models, 128: 101182:1-101182:11, July 2023. DOI: 10.1016/j.gmod.2023.101182.
	[4] Ruggero Pintus, Moonisa Ahsan, Antonio Zorcolo, Fabio Bettio, Fabio Marton, and Enrico Gobbetti. Exploiting Local Shape and Material Similarity for Effective SV-BRDF Reconstruction from Sparse Multi-Light Image Collections. ACM Journal on Computing and Cultural Heritage (JOCCH), 16(2): 39:1-39:31, June 2023. DOI: 10.1145/3593428.
	[5] Moonisa Ahsan. Scalable Exploration of Complex Objects and Environments Beyond Plain Visual Replication. PhD thesis. PhD Programme in Mathematics and Computer Science, University of Cagliari, Italy, 2023.
	[6] Muhammad Tukur, Giovanni Pintore, Enrico Gobbetti, Jens Schneider, and Marco Agus. SPIDER: Spherical Indoor Depth Renderer. In Proc. Smart Tools and Applications in Graphics (STAG). Pages 131-138, October 2022. DOI: 10.2312/stag.20221267.
	[7] Giovanni Pintore, Marco Agus, Eva Almansa, and Enrico Gobbetti. Instant Automatic Emptying of Panoramic Indoor Scenes. IEEE Transactions on Visualization and Computer Graphics, 28(11): 3629-3639, November 2022. DOI: 10.1109/TVCG.2022.3202999. Proc. ISMAR.
	[8] Moonisa Ahsan, Giuliana Altea, Fabio Bettio, Marco Callieri, Antonella Camarda, Paolo Cignoni, Enrico Gobbetti, Paolo Ledda, Alessandro Lutzu, Fabio Marton, Giuseppe Mignemi, and Federico Ponchio. Ebb & Flow: Uncovering Costantino Nivola's Olivetti Sandcast through 3D Fabrication and Virtual Exploration. In The 20th Eurographics Workshop on Graphics and Cultural Heritage. Pages 85-94, September 2022. DOI: 10.2312/gch.20221230.
	[9] Moonisa Ahsan, Fabio Marton, Ruggero Pintus, and Enrico Gobbetti. Audio-visual Annotation Graphs for Guiding Lens-based Scene Exploration. Computers & Graphics, 105: 131-145, 2022. DOI: 10.1016/j.cag.2022.05.003.
	[10] Bipul Mohanto, ABM Tariqul Islam, Enrico Gobbetti, and Oliver Staadt. An integrative view of foveated rendering. Computers & Graphics, 102: 474-501, 2022. DOI: 10.1016/j.cag.2021.10.010.
	[11] Giovanni Pintore, Eva Almansa, Marco Agus, and Enrico Gobbetti. Deep3DLayout: 3D Reconstruction of an Indoor Layout from a Spherical Panoramic Image. ACM Transactions on Graphics, 40(6): 250:1-250:12, December 2021. DOI: 10.1145/3478513.3480480. Proc. SIGGRAPH Asia 2021.
	[12] Ruggero Pintus, Moonisa Ahsan, Fabio Marton, and Enrico Gobbetti. Exploiting Neighboring Pixels Similarity for Effective SV-BRDF Reconstruction from Sparse MLICs. In The 19th Eurographics Workshop on Graphics and Cultural Heritage, November 2021. DOI: 10.2312/gch.20211412. Best paper award at GCH 2021.
	[13] Moonisa Ahsan, Fabio Marton, Ruggero Pintus, and Enrico Gobbetti. Guiding Lens-based Exploration using Annotation Graphs. In Proc. Smart Tools and Applications in Graphics (STAG). Pages 85-90, October 2021. DOI: 10.2312/stag.20211477. Honorable mention in best paper award category at STAG 2021.
	[14] Fabio Bettio, Moonisa Ahsan, Fabio Marton, and Enrico Gobbetti. A novel approach for exploring annotated data with interactive lenses. Computer Graphics Forum, 40(3): 387-398, 2021. DOI: 10.1111/cgf.14315. Proc. EUROVIS 2021.
	[15] Giovanni Pintore, Marco Agus, Eva Almansa, Jens Schneider, and Enrico Gobbetti. SliceNet: deep dense depth estimation from a single indoor panorama using a slice-based representation. In Proc. IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). Pages 11531-11540, 2021. DOI: 10.1109/CVPR46437.2021.01137. Selected as oral presentation.
	[16] Alberto Jaspe Villanueva, Moonisa Ahsan, Ruggero Pintus, Andrea Giachetti, and Enrico Gobbetti. Web-based Exploration of Annotated Multi-Layered Relightable Image Models. ACM Journal on Computing and Cultural Heritage (JOCCH), 14(2): 24:1-24:31, May 2021. DOI: 10.1145/3430846.
	[17] Giovanni Pintore, Marco Agus, and Enrico Gobbetti. AtlantaNet: Inferring the 3D Indoor Layout from a Single 360 Image beyond the Manhattan World Assumption. In Proc. ECCV. Pages 432-448, August 2020. DOI: 10.1007/978-3-030-58598-3_26.
	[18] Giovanni Pintore, Claudio Mura, Fabio Ganovelli, Lizeth Fuentes-Perez, Renato Pajarola, and Enrico Gobbetti. Automatic 3D Reconstruction of Structured Indoor Environments. In SIGGRAPH 2020 Courses. Pages 10:1-10:218, August 2020. DOI: 10.1145/3388769.3407469.
	[19] Giovanni Pintore, Claudio Mura, Fabio Ganovelli, Lizeth Fuentes-Perez, Renato Pajarola, and Enrico Gobbetti. State-of-the-art in Automatic 3D Reconstruction of Structured Indoor Environments. Computer Graphics Forum, 39(2): 667-699, 2020. DOI: 10.1111/cgf.14021.

Related videos

	Giovanni Pintore, Marco Agus, Eva Almansa, and Enrico Gobbetti Instant Automatic Emptying of Panoramic Indoor Scenes CRS4 Video n. 186 - Date: November, 2022 Presented at ISMAR 2022
	Moonisa Ahsan, Giuliana Altea, Fabio Bettio, Marco Callieri, Antonella Camarda, Paolo Cignoni, Enrico Gobbetti, Paolo Ledda, Alessandro Lutzu, Fabio Marton, Giuseppe Mignemi, and Federico Ponchio Uncovering Costantino Nivola's Olivetti Sandcast through 3D Fabrication and Virtual Exploration CRS4 Video n. 185 - Date: September, 2022 Presented at The 20th Eurographics Workshop on Graphics and Cultural Heritage
	Moonisa Ahsan, Fabio Bettio, Enrico Gobbetti, Fabio Marton, Ruggero Pintus, and Antonio Zorcolo EVOCATION: Reconstruction and exploration with an interactive lens of an annotated Nora Stone CRS4 Video n. 183 - Date: July, 2022
	Moonisa Ahsan, Fabio Bettio, Enrico Gobbetti, Fabio Marton, Ruggero Pintus, and Antonio Zorcolo EVOCATION: Acquisition, reconstruction, and exploration of paintings from retable of San Bernardino. CRS4 Video n. 182 - Date: July, 2022
	Fabio Bettio, Moonisa Ahsan, Fabio Marton, and Enrico Gobbetti. A novel approach for exploring annotated data with interactive lenses CRS4 Video n. 181 - Date: June 2021 Presented at EUROVIS 2021