Multidimensional Affective Model-based Multimodal Complex Emotion Recognition System using Image, Voice and Brainwave

摘要

This paper proposed a multimodal complex emotion recognition system using image, voice, and brainwave based on multidimensional affective model. Based on face image, voice, and brain wave of users, features corresponding to the explicit response degree in multidimensional affective model known as emotional response elements were extracted and scored to construct human emotions in the field of psychology and cognitive science. By mapping three-dimensional emotion model consisting of the multidimensional affective model using results from our scoring method, human emotions and the intensity of emotions are recognized.