A Novel Triangulation Method for Building Parallel-Perspective Stereo Mosaics

摘要

In this paper, we propose an improved triangulation method for building parallel-perspective stereo mosaics using ray interpolation. The currently available fast PRISM (Parallel Ray Interpolation for Stereo Mosaicing) uses a constant triangulation technique that does not take advantage of the spatial information. This works well when the inter-frame displacement in the video is small. However, for large inter-frame displacements, hence large motion parallax, we observe visual artifacts in the mosaics when the source triangles in the video frames are warped into destination triangles in the mosaics using affine transformations. Our method uses the edge information present in the scene to ensure that triangles do not cross over from one planar facet to the other. The video frames are segmented and the edges are obtained from the boundaries of different segments. The motion over the entire region in each triangle is constant. Hence, this method avoids unwanted warping of objects with large motion parallax in the scene and reduces the visual artifacts. The performance of our proposed technique is demonstrated on a series of simple to complex video imagery collected by utilizing cameras and airborne sensors.