首页> 外文会议>International AAAI Conference on Web and Social Media >Fusing Audio, Textual, and Visual Features for Sentiment Analysis of News Videos
【24h】

Fusing Audio, Textual, and Visual Features for Sentiment Analysis of News Videos

机译:融合音视频的音频,文本和视觉特征,了解新闻视频的情感分析

获取原文

摘要

This paper presents a novel approach to perform sentiment analysis of news videos, based on the fusion of audio, textual and visual clues extracted from their contents. The proposed approach aims at contributing to the semiodiscoursive study regarding the construction of the ethos (identity) of this media universe, which has become a central part of the modern-day lives of millions of people. To achieve this goal, we apply state-of-the-art computational methods for (1) automatic emotion recognition from facial expressions, (2) extraction of modulations in the participants' speeches and (3) sentiment analysis from the closed caption associated to the videos of interest. More specifically, we compute features, such as, visual intensities of recognized emotions, field sizes of participants, voicing probability, sound loudness, speech fundamental frequencies and the sentiment scores (polarities) from text sentences in the closed caption. Experimental results with a dataset containing 520 annotated news videos from three Brazilian and one American popular TV newscasts show that our approach achieves an accuracy of up to 84% in the sentiments (tension levels) classification task, thus demonstrating its high potential to be used by media analysts in several applications, especially, in the journalistic domain.
机译:本文介绍了一种新颖的方法,以基于从其内容提取的音频,文本和视觉线索的融合来实现新闻视频的情感分析。拟议的方法旨在为该媒体宇宙的欧洲州的建设(身份)建设有贡献,这已成为数百万人的现代生活中的核心部分。为了实现这一目标,我们应用最先进的计算方法(1)来自面部表情的自动情绪识别,(2)参与者的演讲中的调制和(3)情绪分析与相关的封闭标题感兴趣的视频。更具体地,我们计算特征,例如认可情绪的视觉强度,参与者的现场大小,发声概率,声音响度,语音基本频率和情绪得分(极性)从密闭标题中的文本句子。实验结果与三个巴西和一家美国流行电视新闻广播公司的数据集具有520个注释新闻视频表明,我们的方法在情绪(张力水平)分类任务中实现了高达84%的准确性,从而展示了其高潜力媒体分析师在几种应用中,特别是在新闻领域。

著录项

相似文献

  • 外文文献
  • 中文文献
  • 专利
获取原文

客服邮箱:kefu@zhangqiaokeyan.com

京公网安备:11010802029741号 ICP备案号:京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有
  • 客服微信

  • 服务号