An open source integrated framework for rapid prototyping of multimodal affective applications in digital entertainment

摘要

Multimodal interfaces are becoming more and more an emerging leading-edge area of interest in the Digital Art and Entertainment Domain. This paper aims at proposing a new approach to develop applications relying on integration of multimodal modules which can capture and collect the emotional states of the audience, process them and provide a final emotional output. A concrete framework has been designed and is being developed to provide application designers with a powerful and easy-to-use set of tools for building up multimodal affective interfaces. The proposed approach has been conceived inside the FP6 EU co-funded CALLAS (Conveying Affectiveness in Leading-edge Living Adaptive Systems) Project.