【24h】

Films, Affective Computing and Aesthetic Experience: Identifying Emotional and Aesthetic Highlights from Multimodal Signals in a Social Setting

机译:电影,情感计算和审美体验:从社交环境中的多模式信号中识别情感和审美亮点

获取原文

摘要

Over the last years affective computing has been strengthening its ties with the humanities, exploring and building understanding of people's responses to specific artistic multimedia stimuli. 'Aesthetic experience' is acknowledged to be the subjective part of some artistic exposure, namely, the inner affective state of a person exposed to some artistic object. In this work we describe ongoing research activities for studying the aesthetic experience of people when exposed to movie artistic stimuli. To do so, this work is focused on the definition of emotional and aesthetic highlights in movies and studies the people responses to them using physiological and behavioural signals, in a social setting. In order to examine the suitability of multimodal signals for detecting highlights we initially evaluate a supervised highlight detection system. Further, in order to provide an insight on the reactions of people, in a social setting, during emotional and aesthetic highlights, we study two unsupervised systems. Those systems are able to (a) measure the distance among the captured signals of multiple people using the dynamic time warping algorithm and (b) create a reaction profile for a group of people that would be indicative of whether that group reacts or not at a given time. The results indicate that the proposed systems are suitable for detecting highlights in movies and capturing some form of social interactions across different movie genres. Moreover, similar social interactions during exposure to emotional and some types of aesthetic highlights, such as those corresponding to technical or lightening choices of the director, can be observed. The utilisation of electrodermal activity measurements yields in better performances than those achieved when using acceleration measurements, whereas fusion of the modalities does not appear to be beneficial for the majority of the cases.
机译:过去几年中,情感计算一直在加强其与人文科学的联系,探索并建立人们对特定艺术多媒体刺激的反应的理解。人们认为“审美体验”是某些艺术作品的主观部分,即一个人暴露于某种艺术作品的内在情感状态。在这项工作中,我们描述了正在进行的研究活动,以研究人们在受到电影艺术刺激时的审美体验。为此,这项工作着眼于电影中情感和审美重点的定义,并研究人们在社交环境中使用生理和行为信号对它们的反应。为了检查多模态信号对高光检测的适用性,我们首先评估了一个受监督的高光检测系统。此外,为了提供人们在社会环境中在情感和审美亮点中的反应的见解,我们研究了两种无监督的系统。这些系统能够(a)使用动态时间规整算法测量多个人的捕获信号之间的距离,并且(b)为一组人创建反应概况,以指示该人群是否在某个时间做出反应。给定时间。结果表明,所提出的系统适用于检测电影中的精彩片段并捕获不同电影类型之间某种形式的社交互动。此外,可以观察到在暴露于情感和某些类型的美学亮点(例如与导演的技术选择或美化选择相对应的那些)期间发生的相似的社交互动。与使用加速度测量获得的性能相比,使用皮肤电活动测量可获得更好的性能,而模式的融合对于大多数情况似乎并不有益。

著录项

相似文献

  • 外文文献
  • 中文文献
  • 专利
获取原文

客服邮箱:kefu@zhangqiaokeyan.com

京公网安备:11010802029741号 ICP备案号:京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有
  • 客服微信

  • 服务号