Application of geometry to RGB images for facial landmark localisation - a preliminary approach

摘要

This study proposes a novel approach to automatically localise 11 landmarks from facial RGB images. The novelty of this method relies on the application, i.e., point-by-point mapping, of 11 differential geometry descriptors such as curvatures to the three individual RGB image components. Thus, three-dimensional features are applied to bidimensional facial image representations and used, via thresholding techniques, to extract the landmark positions. The method was tested on the Bosphorus database and showed global average errors lower than five millimetres. The idea behind this approach is to embed this methodology in state-of-the-art 3D landmark detection methods to accomplish a full automatic landmarking by exploiting the advantages of both 2D and 3D data. Some landmarks such as pupils are arduous to be automatically extracted only via three-dimensional techniques. Thus, this method is intended as a bridging-the-gap preliminary technique that takes advantages of 2D imaging only for integrating advanced landmark localisation methodologies.