Spatio-temporal Consistency in Stereoscopic Video Depth Map Sequence Estimation

摘要

To solve the flickering artifacts caused by temporal inconsistency and smooth inaccuracy caused by spatial inconsistency in stereoscopic video depth map sequence estimation, the proposed algorithm takes into account the temporal and spatial factors when using the graph cut based on epipolar rectification. In temporal domain, the penalty function with coherence factor is introduced for temporal consistency and the factor is determined by similarity constraint on the basis of Lucas-Kanade Optical Flow Weighted Histogram. In spatial domain, the Joint Bilateral Truncated Absolute Difference is proposed for segmentation smooth which will smooth naturally and uniformly in low-gradient region and avoid over-smoothing as well as keep edge sharpness in high-gradient discontinuities to realize spatial consistency. The experimental results show that the algorithm can effectively solve the flickering artifacts and smooth inaccuracy to obtain better spatio-temporal consistent depth map sequence.