Spatio-Temporal Deepfake Detection with Deep Neural Networks

摘要

Deepfakes generated by generative adversarial neural networks may threaten not only individuals but also pose a public threat. In this regard, detecting video content manipulations is an urgent task, and many researchers propose various methods to solve it. Nevertheless, the problem remains. In this paper, the existing approaches are evaluated, and a new method for detecting deepfakes in videos is proposed. Considering that deepfakes are inserted into the video frame by frame, when viewing it, even with the naked eye, fluctuations and temporal distortions are noticeable, which are not taken into account by many deepfake detection algorithms that use information from a single frame to search for forgeries out of context with neighboring frames. It is proposed to analyze information from a sequence of multiple consecutive frames to detect deepfakes in video content by processing the video using the sliding window approach, taking into account not only spatial intraframe dependencies but also interframe temporal dependencies. Experiments have shown the advantage and potential for further development of the proposed approach over simple intraframe recognition.