An Image-Based Approach for 3D Reconstruction of Urban Scenes Using Architectural Symmetries

摘要

We present an approach to exploit complex 3D symmetries exhibited by urban structures in order to improve 3D reconstruction be used, ranging from primitive symmetries [18] to complex symmetry groups. We achieve this by rigorously modeling complex symmetries, using the mathematical theory underlying them to develop generative models of 3D points involved in a given scene symmetry. A key element of our approach is to express the 3D structure of a symmetric scene, imaged by a camera, as comprised of non-decomposable 3D elements known as asymmetric units. We apply our approach in both single and multi-view settings and show that we can obtain denser, more compressed, and qualitatively better-looking representations of the observed structure by exploiting constraints derived from symmetry.