Adaptive appearance compensated view synthesis prediction for Multiview Video Coding

摘要

View synthesis prediction has been studied to achieve efficient inter-view prediction. Existing view synthesis prediction methods synthesize predicted pictures by using decoded pictures from the other views and geometric information of the scene. However, these conventional methods have no ability to compensate the inter-view difference in image signals caused by individual camera characteristics and the nonLambert reflection of objects. This paper proposes adaptive appearance compensated view synthesis prediction; it uses adaptive filters to compensate not only the differences in color and brightness but also the differences in the spatial frequency of images. The object-dependent local differences are also compensated efficiently by estimating the optimal compensation parameters block by block at the decoder. Experiments show that the proposed method reduces the bitrate by up to 40% relative to H.264/AVC multiview video coding, and 26% relative to the conventional view synthesis prediction.