New frame rate up-conversion based on foreground/background segmentation

摘要

Frame rate up-conversion (FRUC) increases the quality of a video by increasing its temporal frequency. Motion compensated and non-motion compensated frame rate up conversion techniques make up the two main classes of techniques used in this area. Halo artifacts and jaggy edges cause the quality of video to be reduced both subjectively and objectively in these techniques. In this paper, we introduce a new method of motion compensated FRUC that uses foreground background segmentation to address these problems. It checks up the neighbors of gap pixels and deciding which neighbors should be used to interpolate or extrapolate according to their foreground or background identity. The current work reduces block artifacts by scaling motion vectors of existent frames to motion vectors of interpolated frames by using the foreground/background segmentation information. The proposed method improves the quality of video and obtains better PSNR results than the proposed methods of [9], [13] and [14].