A Content-Based Rapid Video Playback Method Using Motion-Based Video Time Density Function and Temporal Quantization

摘要

In this paper, we propose a new content-based rapid video playback method using motion-based video time density function (MVTDF) and temporal quantization. In particular, we formulate the rapid video playback problem as a generic sampling problem. We present a novel MVTDF using the inter-frame mutual information in pixel level to describe the time density of video motion activities. A MVTDF-based temporal quantization method is then employed to find the best quanta and partition in time domain. The video frames that are the nearest neighbors to the quanta in the quantization codebook are sampled to navigate the video in a non-uniform way. By selecting the most salient set of frames, the technique is integrated into a video player for variable-rate rapid video playback that preserves content. The implementation of video player demonstrates the feasibility of proposed method in practice. Experimental results show that the proposed method is effective to capture the important semantic information of video data during rapid playback.