首页> 外文会议>International Conference on Intelligent Environments >MobileSSI - A Multi-modal Framework for Social Signal Interpretation on Mobile Devices
【24h】

MobileSSI - A Multi-modal Framework for Social Signal Interpretation on Mobile Devices

机译:MobileSSI-移动设备上社交信号解释的多模式框架

获取原文

摘要

Over the last years, new generations of mobile devices have found their way into our pockets. They provide more and more computational power and memory capacity to perform complex calculations that formerly could only be accomplished with bulky desktop machines. Moreover, mobile devices are equipped with a range of sensors to capture people's motion, environmental sound etc. These capabilities combined with the willingness of people to permanently carry them around open up completely new ways of observing human behaviour no longer in laboratories, but "in the wild". However, the detection and analysis of social cues is still a challenging task and requires adequate tools to synchronise, process and analyse relevant signals. This may be the reason why many studies and applications focus on offline analysis and typically collect data over long periods of time and analyse them afterwards. To allow for immediate feedback, real-time assessment is necessary. In this paper, we present MobileSSI, a port of the Social Signal Interpretation (SSI) framework to Android and embedded Linux platforms. The framework supports the joint development of processing pipelines for the analysis of social signals on a desktop computer and mobile devices. Throughout the paper we report on challenges we had to face when porting SSI to a mobile context. Furthermore, we summarise first experiences with a real-life setting in a pub where we focused on the analysis of multimodal social group dynamics investigating laughter as a sign of enjoyment.
机译:在过去的几年中,新一代的移动设备已经进入我们的口袋。它们提供越来越多的计算能力和内存容量来执行以前只能使用笨重的台式机才能完成的复杂计算。此外,移动设备配备了一系列传感器来捕获人们的动作,环境声音等。这些功能与人们永久性地携带它们的意愿相结合,开辟了一种全新的观察人类行为的新方法,而不再是实验室中的行为。野外”。但是,社交线索的检测和分析仍然是一项艰巨的任务,需要足够的工具来同步,处理和分析相关信号。这可能就是为什么许多研究和应用程序都专注于脱机分析并通常长时间收集数据并随后进行分析的原因。为了获得即时反馈,必须进行实时评估。在本文中,我们介绍了MobileSSI,它是社交信号解释(SSI)框架到Android和嵌入式Linux平台的端口。该框架支持联合开发处理管线,以分析台式计算机和移动设备上的社交信号。在整篇文章中,我们报告了将SSI移植到移动环境时必须面对的挑战。此外,我们总结了在一家酒吧中的真实生活中的首次体验,在该酒吧中,我们专注于多模式社会群体动态分析,将笑声作为一种享受的标志。

著录项

相似文献

  • 外文文献
  • 中文文献
  • 专利
获取原文

客服邮箱:kefu@zhangqiaokeyan.com

京公网安备:11010802029741号 ICP备案号:京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有
  • 客服微信

  • 服务号