User -independent Face Landmark Detection and Tracking Apparatus for Spatial Augmented Reality Interaction

摘要

The present invention relates to a model-independent face landmark recognizing device in space augmented reality comprising: an image obtaining unit; a face feature detecting unit; and a landmark detecting unit. The image obtaining unit obtains a face image including a color image and a depth image. The face feature detecting unit detects a face area from the face image obtained in the image obtaining unit; measures a local binary pattern in the color image; and measures a face feature of the face image combined with a local before pattern and each local pattern by measuring each local pattern in the depth image. The landmark detecting unit forms a face topology tree which is a face topology relation tree by dividing an upper face landmark set into two lower groups; learns to have a partial landmark image including a face landmark partial set depending on the face topology tree in each node of a potential regression forest in a process of learning to have a plurality of test face images including an entire face landmark which coincides with a root node of the face topology tree; and calculates a result value of the partial landmark by accumulating a difference of position values stored in a division node and a leaf node by traversing the learned forest when the face feature of the face image detected in the face feature detecting unit is set as an input value. The present invention facilitates real-time virtual makeup.