Integration of Stereo Vision and Optical Flow Using Energy Minimization Approach

摘要

A cooperative motion-stereo method is proposed where image intensity (brightness)and optical flow information are integrated into a single stereo technique by modeling the input data as coupled Markov Random Fields (MRF). The Bayesian probabilistic estimation method and the MRF-Gibbs equivalence theory are used to integrate the optical flow and the gray level intensity information to obtain an energy function which will explicitly represent the depth discontinuity and occlusion constraints on the solution. This energy function involves the similarity in intensity (or edge orientation) and the optical flow between corresponding sites of the left and right images as well as the smoothness constraint on the disparity solution. If a simple MRF is used to model the data, the energy function will yield a poor disparity by smoothing across object boundaries, particularly when occluding objects are present. We exploit optical flow information to indicate object boundaries (depth discontinuities) and occluded regions, in order to improve the disparity solution in occluded regions. A stochastic relaxation algorithm (Simulated Annealing) is used to find a favorable disparity solution by minimizing the energy equation.