Detection and Localization of Video Object Removal by Spatio-Temporal LBP Coherence Analysis

摘要

Local object removal on video can directly affect our understanding and cognition of the video content without changing the motion continuity of other moving objects in the same video frame. Forgers can use video editing tools or certain inpainting techniques to remove undesired objects easily for covering up the truth. In this paper, we present a new approach based on spatio-temporal LBP coherence analysis for detection and localization of forged regions, which are generated by removing unwanted objects from the video. The proposed method starts with frames alignment to handle camera motion. And then the coherence analysis on the spatial LBP operator between two adjacent frames is performed to find the possible forged region. Finally, the temporal LBP operator is utilized to remove the false positives so as to obtain the final abnormal area. Two common region-level inpainting methods are adopted to simulate two different types of forgery processes for performance evaluation of our scheme. The experimental results prove that our method is effective in detecting and locating the forged regions and superior to the existing two approaches.