Fast and Robust Semi-Automatic Registration of Photographs to 3D Geometry
Ruggero Pintus, Enrico Gobbetti, and Roberto Combet
October 2011
Abstract
We present a simple, fast and robust technique for semi-automatic 2D-3D registration capable to align a large set of unordered images to a massive point cloud with minimal human effort. Our method converts the hard to solve image-to-geometry registration problem in a Structure-from-Motion (SfM) plus a 3D-3D registration problem. We exploit a SfM framework that, starting just from the unordered image collection, computes an estimate of camera parameters and a sparse 3D geometry deriving from matched image features. We then coarsely register this model to the given 3D geometry by estimating a global scale and absolute orientation using minimal manual intervention. A specialized sparse bundle adjustment (SBA) step, exploiting the correspondence between the model deriving from image features and the fine input 3D geometry, is then used to refine intrinsic and extrinsic parameters of each camera. Output data is suitable for photo blending frameworks to produce seamless colored models. The effectiveness of the method is demonstrated on a series of real-world 3D/2D Cultural Heritage datasets.
Reference and download information
Ruggero Pintus, Enrico Gobbetti, and Roberto Combet. Fast and Robust Semi-Automatic Registration of Photographs to 3D Geometry. In The 12th International Symposium on Virtual Reality, Archaeology and Cultural Heritage. Pages 9-16, October 2011.
Related multimedia productions
Bibtex citation record
@InProceedings{Pintus:2011:FRS, author = {Ruggero Pintus and Enrico Gobbetti and Roberto Combet}, title = {Fast and Robust Semi-Automatic Registration of Photographs to {3D} Geometry}, booktitle = {The 12th International Symposium on Virtual Reality, Archaeology and Cultural Heritage}, pages = {9-16}, month = {October}, year = {2011}, abstract = { We present a simple, fast and robust technique for semi-automatic 2D-3D registration capable to align a large set of unordered images to a massive point cloud with minimal human effort. Our method converts the hard to solve image-to-geometry registration problem in a Structure-from-Motion (SfM) plus a 3D-3D registration problem. We exploit a SfM framework that, starting just from the unordered image collection, computes an estimate of camera parameters and a sparse 3D geometry deriving from matched image features. We then coarsely register this model to the given 3D geometry by estimating a global scale and absolute orientation using minimal manual intervention. A specialized sparse bundle adjustment (SBA) step, exploiting the correspondence between the model deriving from image features and the fine input 3D geometry, is then used to refine intrinsic and extrinsic parameters of each camera. Output data is suitable for photo blending frameworks to produce seamless colored models. The effectiveness of the method is demonstrated on a series of real-world 3D/2D Cultural Heritage datasets. }, url = {http://vic.crs4.it/vic/cgi-bin/bib-page.cgi?id='Pintus:2011:FRS'}, }
The publications listed here are included as a means to ensure timely
dissemination of scholarly and technical work on a non-commercial basis.
Copyright and all rights therein are maintained by the authors or by
other copyright holders, notwithstanding that they have offered their works
here electronically. It is understood that all persons copying this
information will adhere to the terms and constraints invoked by each
author's copyright. These works may not be reposted without the
explicit permission of the copyright holder.
Please contact the authors if you are willing to republish this work in
a book, journal, on the Web or elsewhere. Thank you in advance.
All references in the main publication page are linked to a descriptive page
providing relevant bibliographic data and, possibly, a link to
the related document. Please refer to our main
publication repository page for a
page with direct links to documents.