Facial image analysis has been an important subject of study in the communities of pattern recognition and computer vision. Facial images contain much information about the person they belong to like identity, age, gender, ethnicity, and expression. This paper introduces a new framework that exploits facial deep features for kinship verification. The framework integrates efficient feature selection and kinship-oriented discriminant data projection. The resulting framework incorporates three levels of fusion: (1) an early fusion of descriptors where the filter selection selects the most relevant deep features, (2) a middle-stage fusion which exploits a kinship-based multi-view metric learning method, and (3) a late-stage fusion that merges classifiers responses. In our study, face features are provided by the pre-trained deep convolutional neural networks VGG-F and VGG-Face that were originally proposed for discriminating categories of objects and identities, respectively. Experimental results on two benchmarked datasets for kinship verification in the wild (KinFaceW-I and KinFaceW-II) show that the proposed framework outperforms state-of-the-art techniques without the use of external data or data augmentation that are tailored for the kinship verification problem. These experiments show that the proposed scheme can outperform feature fusion obtained by deep multi-metric learning.
展开▼
