REAL-TIME NON-RIGID DRIVER HEAD TRACKINGFOR DRIVER MENTAL STATE ESTIMATION

摘要

The non-rigid motion of a driver's head (I.e. the motion of their mouth, eye-brows, cheeks,etc) can tell us a lot about their mental state; e.g. whether they are drowsy, alert, aggressive,comfortable, tense, distracted, etc. In this paper, we describe our recent research on nonrigidface tracking. In particular, we present both 2D and 3D algorithms for tracking thenon-rigid motion of the driver's head using an Active Appearance Model. Both algorithmsoperate at over 200 frames per second. We also present algorithms for converting a 2Dmodel into a 3D model and for fitting with occlusion and large pose variation.