Crack Detection in Single- and Multi-Light Images of Painted Surfaces using Convolutional Neural Networks
Tinsae Dulecha, Andrea Giachetti, Ruggero Pintus, Irina Ciortan, Alberto Jaspe Villanueva, and Enrico Gobbetti
November 2019
Abstract
Cracks represent an imminent danger for painted surfaces that needs to be alerted before degenerating into more severe aging effects, such as color loss. Automatic detection of cracks from painted surfaces' images would be therefore extremely useful for art conservators; however, classical image processing solutions are not effective to detect them, distinguish them from other lines or surface characteristics. A possible solution to improve the quality of crack detection exploits Multi-Light Image Collections (MLIC), that are often acquired in the Cultural Heritage domain thanks to the diffusion of the Reflectance Transformation Imaging (RTI) technique, allowing a low cost and rich digitization of artworks' surfaces. In this paper, we propose a pipeline for the detection of crack on egg-tempera paintings from multi-light image acquisitions and that can be used as well on single images. The method is based on single or multi-light edge detection and on a custom Convolutional Neural Network able to classify image patches around edge points as crack or non-crack, trained on RTI data. The pipeline is able to classify regions with cracks with good accuracy when applied on MLIC. Used on single images, it can give still reasonable results. The analysis of the performances for different lighting directions also reveals optimal lighting directions.
Reference and download information
Tinsae Dulecha, Andrea Giachetti, Ruggero Pintus, Irina Ciortan, Alberto Jaspe Villanueva, and Enrico Gobbetti. Crack Detection in Single- and Multi-Light Images of Painted Surfaces using Convolutional Neural Networks. In The 16th Eurographics Workshop on Graphics and Cultural Heritage. Pages 43-50, November 2019. DOI: 10.2312/gch.20191347.
Related multimedia productions
Bibtex citation record
@inproceedings{Dulecha:2019:CDS, author = {Tinsae Dulecha and Andrea Giachetti and Ruggero Pintus and Irina Ciortan and Alberto {Jaspe Villanueva} and Enrico Gobbetti}, title = {Crack Detection in Single- and Multi-Light Images of Painted Surfaces using Convolutional Neural Networks}, booktitle = {The 16th Eurographics Workshop on Graphics and Cultural Heritage}, pages = {43--50}, month = {November}, year = {2019}, abstract = { Cracks represent an imminent danger for painted surfaces that needs to be alerted before degenerating into more severe aging effects, such as color loss. Automatic detection of cracks from painted surfaces' images would be therefore extremely useful for art conservators; however, classical image processing solutions are not effective to detect them, distinguish them from other lines or surface characteristics. A possible solution to improve the quality of crack detection exploits Multi-Light Image Collections (MLIC), that are often acquired in the Cultural Heritage domain thanks to the diffusion of the Reflectance Transformation Imaging (RTI) technique, allowing a low cost and rich digitization of artworks' surfaces. In this paper, we propose a pipeline for the detection of crack on egg-tempera paintings from multi-light image acquisitions and that can be used as well on single images. The method is based on single or multi-light edge detection and on a custom Convolutional Neural Network able to classify image patches around edge points as crack or non-crack, trained on RTI data. The pipeline is able to classify regions with cracks with good accuracy when applied on MLIC. Used on single images, it can give still reasonable results. The analysis of the performances for different lighting directions also reveals optimal lighting directions. }, doi = {10.2312/gch.20191347}, url = {http://vic.crs4.it/vic/cgi-bin/bib-page.cgi?id='Dulecha:2019:CDS'}, }
The publications listed here are included as a means to ensure timely
dissemination of scholarly and technical work on a non-commercial basis.
Copyright and all rights therein are maintained by the authors or by
other copyright holders, notwithstanding that they have offered their works
here electronically. It is understood that all persons copying this
information will adhere to the terms and constraints invoked by each
author's copyright. These works may not be reposted without the
explicit permission of the copyright holder.
Please contact the authors if you are willing to republish this work in
a book, journal, on the Web or elsewhere. Thank you in advance.
All references in the main publication page are linked to a descriptive page
providing relevant bibliographic data and, possibly, a link to
the related document. Please refer to our main
publication repository page for a
page with direct links to documents.