首页> 外国专利> VIDEO DESCRIPTION GENERATION METHOD AND APPARATUS, VIDEO PLAYING METHOD AND APPARATUS, AND STORAGE MEDIUM

VIDEO DESCRIPTION GENERATION METHOD AND APPARATUS, VIDEO PLAYING METHOD AND APPARATUS, AND STORAGE MEDIUM

机译:视频描述生成方法和装置,视频播放方法和装置以及存储介质

摘要

The present disclosure discloses a video description generation method and apparatus, a video playing method and apparatus, and a computer-readable storage medium. The method includes: extracting video features, and obtaining a video feature sequence corresponding to video encoding moments in a video stream; encoding the video feature sequence by using a forward recurrent neural network and a backward recurrent neural network, to obtain a forward hidden state sequence and a backward hidden state sequence corresponding to each video encoding moment; and positioning, according to the forward hidden state sequence and the backward hidden state sequence, an event corresponding to each video encoding moment and an interval corresponding to the event at the video encoding moment, thereby predicting a video content description of the event. On the basis of distinguishing overlapping events, the interval corresponding to the event is introduced to predict and generate a word corresponding to the event at the video encoding moment, and events that overlap at the video encoding moment correspond to different intervals, so that the video content descriptions of events at this video encoding moment have a high degree of distinction. By analogy, events in the given video stream can be described more distinctively.
机译:本公开公开了视频描述生成方法和设备,视频播放方法和设备以及计算机可读存储介质。该方法包括:提取视频特征,并获得与视频流中的视频编码时刻对应的视频特征序列;以及通过使用前向递归神经网络和后向递归神经网络对视频特征序列进行编码,得到与每个视频编码时刻对应的前向隐藏状态序列和后向隐藏状态序列;根据前向隐藏状态序列和后向隐藏状态序列,定位每个视频编码时刻对应的事件以及该视频编码时刻对应于该事件的间隔,从而预测该事件的视频内容描述。在区分重叠事件的基础上,引入与事件相对应的间隔,以预测并生成与视频编码时刻的事件相对应的词,并且在视频编码时刻重叠的事件对应于不同的间隔,从而使视频在此视频编码时刻事件的内容描述具有很高的区分度。通过类推,可以更鲜明地描述给定视频流中的事件。

著录项

相似文献

  • 专利
  • 外文文献
  • 中文文献
获取专利

客服邮箱:kefu@zhangqiaokeyan.com

京公网安备:11010802029741号 ICP备案号:京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有
  • 客服微信

  • 服务号