thumbnail

Scan4Reco: Multimodal Scanning of Cultural Heritage Assets for their multilayered digitization and preventive conservation via spatiotemporal 4D Reconstruction and 3D Printing

Details
Funded by: EU H2020Reference: H2020-REFLECTIVE-7-2014 665091
Start: 2015-10-01Duration: 36 months
Partners
Coordinator: CERTHGreece
Contractor: IDRYMA ORMYLIAGreece
Contractor: Fraunhofer IGDGermany
Contractor: University of VeronaItaly
Contractor: Opificio delle Pietre DureItaly
Contractor: CRS4Italy
Contractor: BWTek Europe GmbHGermany
Contractor: Avasha AGSwitzerland
Contractor: RFSATUK

Abstract

Scan4Reco will develop a novel portable, integrated and modular solution for customized and thus cost-effective, automatic digitization and analysis of cultural heritage objects (CHOs), even in situ. A multi-sensorial 3D scanning - facilitated by a mechanical arm – will collect multi-spectra data and then, a hierarchical approach for 3D reconstruction of CHOs will be applied, enabling multi-layered rendering, advancing both analysis and 3D printing procedures. The goal will be to create highly accurate digital surrogates of CHOs, providing also detailed insight over their surface and also the volumetric structure, material composition and shape/structure of underlying materials, enabling rendering either via visualization techniques or via multi-material 3D printing. Material analyses will be applied, to understand the heterogeneous nature and complex structures of CHOs, to identify the broad and varied classes of materials and to understand their degradation mechanisms over time, deriving context-dependant ageing models per material. Uni-material models will be spatiotemporally simulated, based on environmental phenomena modeling, so as to collectively render imminent degradation effects on the multi-material CHOs, enabling prediction and recreation of their future appearance, as well as automatic restoration, reaching even back to their original shape. Scan4Reco will further facilitate conservation, by indicating spots/segments of cultural objects that are in eminent conservation need and require special care, while suggestions will be provided by a dedicated Decision Support System (DSS), over conservation methods that should be followed. All the above will be validated on real case scenarios involving heterogeneous objects of various sizes and materials, in 2 pilot real-world use cases. To enhance the accessibility of the digitized cultural objects to the scientific community, field experts and the general public, a virtual model of a museum will be launched.

Publications

thumbnail
[1] Tinsae Dulecha, Andrea Giachetti, Ruggero Pintus, Irina Ciortan, Alberto Jaspe Villanueva, and Enrico Gobbetti. Crack Detection in Single- and Multi-Light Images of Painted Surfaces using Convolutional Neural Networks. In The 16th Eurographics Workshop on Graphics and Cultural Heritage. Pages 43-50, November 2019. DOI: 10.2312/gch.20191347
thumbnail
[2] Ruggero Pintus, Tinsae Dulecha, Alberto Jaspe Villanueva, Andrea Giachetti, Irina Ciortan, and Enrico Gobbetti. Objective and Subjective Evaluation of Virtual Relighting from Reflectance Transformation Imaging Data. In The 15th Eurographics Workshop on Graphics and Cultural Heritage. Pages 87-96, October 2018. DOI: 0.2312/gch.20181344.
thumbnail
[3] Irina Ciortan, Ruggero Pintus, Enrico Gobbetti, and Andrea Giachetti. Aging Prediction of Cultural Heritage Samples Based on Surface Microgeometry. In The 15th Eurographics Workshop on Graphics and Cultural Heritage. Pages 147-154, October 2018. DOI: 10.2312/gch.20181352.
thumbnail
[4] Irina Ciortan, Tinsae Dulecha, Andrea GIachetti, Ruggero Pintus, Alberto Jaspe Villanueva, and Enrico Gobbetti. Artworks in the Spotlight: Characterization with a Multispectral Dome. IOP Conference Series: Materials Science and Engineering, 364(1): 012025, 2018. DOI: 10.1088/1757-899X/364/1/012025
thumbnail
[5] Irina-Mihaela Ciortan, Ruggero Pintus, Giacomo Marchioro, Claudia Daffara, Enrico Gobbetti, and Andrea Giachetti. A DICOM-Inspired Metadata Architecture for Managing Multimodal Acquisitions in Cultural Heritage. In Digital Cultural Heritage. Volume 10605 of Lecture Notes in Computer Science (LNCS). Pages 37-49, Springer International Publishing, 2018. DOI: 10.1007/978-3-319-75826-8_4
thumbnail
[6] Andrea Giachetti, Irina Ciortan, Claudia Daffara, Giacomo Marchioro, Ruggero Pintus, and Enrico Gobbetti. A Novel Framework for Highlight Reflectance Transformation Imaging. Computer Vision and Image Understanding, 168: 118-131, 2018. DOI: 10.1016/j.cviu.2017.05.014
thumbnail
[7] Andrea Giachetti, Irina Ciortan, Claudia Daffara, Ruggero Pintus, and Enrico Gobbetti. Multispectral RTI Analysis of Heterogeneous Artworks. In The 14th Eurographics Workshop on Graphics and Cultural Heritage. Pages 19-28, September 2017. DOI: 10.2312/gch.20171288. Best paper award. 
thumbnail
[8] Ruggero Pintus, Andrea Giachetti, Giovanni Pintore, and Enrico Gobbetti. Guided Robust Matte-Model Fitting for Accelerating Multi-light Reflectance Processing Techniques. In Proc. British Machine Vision Conference. Pages 32.1-32.15, September 2017. DOI: 10.5244/C.31.32
thumbnail
[9] Ruggero Pintus, Ying Yang, Holly Rushmeier, and Enrico Gobbetti. Automatic Algorithms for Medieval Manuscript Analysis. In Proc. 18th International Graphonomics Society Conference, June 2017. 
thumbnail
[10] Marco Agus, Enrico Gobbetti, Fabio Marton, Giovanni Pintore, and Pere-Pau Vázquez. Mobile Graphics. In Adrien Bousseau and Diego Gutierrez, editors, Proc. EUROGRAPHICS Tutorials, April 2017. DOI: 10.2312/egt.20171032
thumbnail
[11] Ruggero Pintus, Enrico Gobbetti, Marco Callieri, and Matteo Dellepiane. Techniques for seamless color registration and mapping on dense 3D models. In Nicola Masini and Francesco Soldovieri, editors, Sensing the Past: From artifact to historical site. Pages 355-376, Springer, 2017. DOI: 10.1007/978-3-319-50518-3_17
thumbnail
[12] Ruggero Pintus, Irina Ciortan, Andrea Giachetti, and Enrico Gobbetti. Practical Free-form RTI Acquisition with Local Spot Lights. In Proc. Smart Tools and Apps for Graphics, October 2016. DOI: 10.2312/stag.20161374
thumbnail
[13] Irina Ciortan, Ruggero Pintus, Giacomo Marchioro, Claudia Daffara, Andrea Giachetti, and Enrico Gobbetti. A Practical Reflectance Transformation Imaging Pipeline for Surface Characterization in Cultural Heritage. In The 13th Eurographics Workshop on Graphics and Cultural Heritage, October 2016. DOI: 10.2312/gch.20161396