Improving face verification using facial marks and deep CNN: IARPA Janus benchmark-A

摘要

Face verification performance by human brain has been shown to be much better than most of the state-of-theart approaches in computer vision. Performance improvement of automated face recognition (FR) systems that may equal or surpass the human intellect is the key goal of this research. We present our face verification system using facial mark (FM) combined with deep convolutional neural network (DCNN) approach to improve the overall FR accuracy. We propose to use FM (e.g., scars, moles and freckles) for face matching in the wild where the FM detection is performed on mean faces as well as affine aligned normalized facial images. The FR experiments are carried out on IARPA Janus Benchmark-A (IJB-A) dataset which includes real-world unconstrained images from 500 subjects. The IJB-A datasets includes full pose, expression, and illumination variations which are much harder than traditional FERET and Mugshot datasets. We evaluated the average FR performance using a weighted score-level fusion of FM and DCNN based recognition methods. The experimental evaluations on FERET, CFM and Mugshot datasets show higher performances than state-of-the-art FM approaches with 99.23%, 94.64% and 97.86% accuracies in Rank-1 evaluations, respectively. Our FR performance of FM + DCNN (86.46% in TAR, 91.23% in Rank-1, 96.57% in Rank-5, 98.65% in Rank-10) is shown to be higher than state-ofthe-art (83.80% in TAR@1%FAR, 90.30% in Rank-1, 96.5% in Rank-5, and 97.7% in Rank-10). Experimental results after fusion of FM + DCNN on IJB-A dataset show 2.66% FR performance improvement from the DCNN only recognition in terms of TAR@1%FAR. (c) 2020 Published by Elsevier B.V.