Block-Level Entropy-Based Adaptive Sampling Framework for Depth Map

摘要

Recently, the three dimensional (3-D) video technology has drawn significant attention among industry and academic researchers. As a special data format in 3-D video, the depth map consists of gray levels, which are nearly the same within an object but change abruptly across the boundaries. In view of the similarity of the gray levels in the most regions, down-sampling can be employed as the pre-processing and up-sampling as post-processing in most applications of the depth map, such as compression and transmission. Differently from the conventional uniform sampling, in this paper a framework of adaptive sampling is proposed based on block-level entropy according to the context of each block in the depth map. If more complicated context or more boundaries exist in the block, higher sampling rate should be set up while lower sampling rate should be used for smooth regions. Since the block-level entropy can represent the content complexity of each block in the depth map, it can be calculated to determine the adaptive sampling rate. In the experiments, different up-sampling methods are employed in our framework to test and verify the results. Experimental results show that compared with the uniform sampling, the proposed framework has higher objective and subjective quality at the same sampling rate both for the depth map and for the synthesized virtual viewpoint.