首页> 外文期刊>Journal of Systemics, Cybernetics and Informatics >Video Summarization Using Deep Action Recognition Features and Robust Principal Component Analysis
【24h】

Video Summarization Using Deep Action Recognition Features and Robust Principal Component Analysis

机译:使用深度动作识别特征和强大的主成分分析的视频摘要

获取原文
           

摘要

In an instance where desired pre-defined actions, behaviors, or other categories are known a priori, various video classification and recognition models can be trained to discover those classifications and their location within the video. Absent that information, one might still be tasked with identifying interesting portions within a video, a process which—if done manually—is onerous and time-consuming as it requires manual inspection of the video itself. Recognizing high-level interesting segments within a whole video has been a general area of interest due to the ubiquity of video data. However the size of the data makes storage, retrieval, and inspection of large collections of videos cumbersome. This problem motivates the task of generating shortened clips highlighting the primary content of a video, relieving the burden of having to watch the entire video. This paper presents an unsupervised method of creating shortened clips of videos, enabling the rapid review of the most interesting content within a video. Our method uses features extracted from pre-trained action recognition models as input to online moving window robust principal component analysis to generate summaries. The procedure is tested on a publicly available video summarization dataset and demonstrates comparable performance to state-of-the-art in an un-augmented setting while requiring no training.
机译:在所需预定义的动作,行为或其他类别的情况下,已知先验的实例,可以培训各种视频分类和识别模型以发现视频内的分类和位置。缺少该信息,一个人仍然有任务识别视频中的有趣部分,这是一个 - 如果手动完成 - 这是繁重且耗时的过程,因为它需要手动检查视频本身。由于视频数据的难易性,在整个视频中识别出整个视频中的高级有趣的段。然而,数据的大小使存储,检索和检查大量视频繁琐。这个问题激励了产生缩短剪辑的任务,突出显示视频的主要内容,从而减轻了不必观看整个视频的负担。本文介绍了创建视频缩短剪辑的无监督方法,从而快速审查视频中最有趣的内容。我们的方法使用从预先训练的动作识别模型中提取的功能作为在线移动窗口的输入强大的主成分分析以生成摘要。该程序在公开的视频摘要数据集上进行测试,并在未经培训的情况下,在未增强的设置中对最先进的最先进的情况说明了可比性。

著录项

获取原文

客服邮箱:kefu@zhangqiaokeyan.com

京公网安备:11010802029741号 ICP备案号:京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有
  • 客服微信

  • 服务号