Geometric and Optical Flow Based Method for Facial Expression Recognition in Color Image Sequences

摘要

This work proposes new static and dynamic based methods for facial expression recognition in stereo image sequences. Computer vision 3-d techniques are applied to determine real world geometric measures and to build a static geometric feature vector. Optical flow based motion detection is also carried out which delivers the dynamic flow feature vector. Support vector machine classification is used to recognize the expression using geometric feature vector while k-nearest neighbor classification is used for flow feature vector. The proposed method achieves robust feature detection and expression classification besides covering the in/out of plane head rotations and back and forth movements. Further, a wide range of human skin color is exploited in the training and the test samples.