Towards Objective Assessment of Movie Trailer Quality Using Human Electroencephalogram and Facial Recognition

摘要

In this paper, we propose a novel framework to objectively evaluate the quality of movie trailers by fusing two sensing modalities: (1) Human Electroencephalogram (EEG), and (2) computer-vision based facial expression recognition. The EEG sensing data are acquired via a cap instrumented with a set of 4-channel EEG sensors from the OpenBCI Ganglion board. The facial expressions are captured while a user is watching a movie trailer using a regular webcam to help establish the context for EEG analysis. On their own, facial expressions reveal how engaged a user is while watching a movie trailer. Additionally, facial expression data help us identify situations where noises caused by muscle movement in EEG data. Using a shallow neural network, we classify facial expressions into two categories: positive and negative emotions. A quarter-central decision making strategy model is used to analyze EEG signals with a low pass filter activated by time stamp when large human movements are detected. A small human subject test showed that the adaptive analysis method can achieve higher accuracy than that obtained via EEG alone. Besides for movie trailer evaluation, this framework can be utilized in the future towards remote training evaluation, wearable device personalization, and assisting paralyzed people to communicate with others.