前景时空域分析和背景理解相结合的2D/3D视频转换方法

摘要

视觉感知心理学表明,人在观看视频时注意力主要集中于前景目标,而对背景不敏感.基于该理论,提出一种基于前景和背景分割的2D/3D视频转换方法.首先使用背景模型提取视频中运动的前景目标,并使用视觉注意力模型定位观众感兴趣的前景目标,从而将视频分割为前景和背景;然后通过分析理解背景中景物构图关系,结合针孔相机模型估计背景的景物深度;对于前景,则通过考察视频空域中前景和背景之间的构图关系以及时域中前景目标的特征变化,确定前景目标的深度;最后将视频前景和背景的深度估计结果进行融合,完成2D/3D视频转换.实验结果表明,文中的方法可应用于各类视频场景,且估计的视频深度信息能够准确地反映场景中各类景物在真实世界的位置分布.%According to the psychology analysis of human visual perceiving, people tend to pay more attention to the foreground than the background in watching videos.In this paper, a novel 2D to 3D conversion method based on segmenting the foreground from the background is proposed.Firstly, the moving objects are detected by background model and refined by attention model so as to extract the foreground objects in interests.Secondly, every object in the background is found by machine learning method, and the depth of the background object is estimated based on the pin-hole camera model.Thirdly, the depth of the foreground is estimated by its location and the frame coherence.Finally, the depth of foreground and background are integrated.The experiments showed that our algorithm can be easily applied to many scenes and the result of depth estimation reflects the location of each object in the real world exactly.