Kinship Verification from Videos using Spatio-Temporal Texture Features and Deep Learning

摘要

Automatic kinship verification using facial images is a relatively new andchallenging research problem in computer vision. It consists in automaticallypredicting whether two persons have a biological kin relation by examiningtheir facial attributes. While most of the existing works extract shallowhandcrafted features from still face images, we approach this problem fromspatio-temporal point of view and explore the use of both shallow texturefeatures and deep features for characterizing faces. Promising results,especially those of deep features, are obtained on the benchmark UvA-NEMO Smiledatabase. Our extensive experiments also show the superiority of using videosover still images, hence pointing out the important role of facial dynamics inkinship verification. Furthermore, the fusion of the two types of features(i.e. shallow spatio-temporal texture features and deep features) showssignificant performance improvements compared to state-of-the-art methods.