Nystrom Approximations for Scalable Face Recognition: A Comparative Study

摘要

Kernel principal component analysis (KPCA) is a widely-used statistical method for representation learning, where PCA is performed in reproducing kernel Hilbert space (RKHS) to extract nonlinear features from a set of training examples. Despite the success in various applications including face recognition, KPCA does not scale up well with the sample size, since, as in other kernel methods, it involves the eigen-decomposition of n×n Gram matrix which is solved in O(n~3) time. Nystroem method is an approximation technique, where only a subset of size m«n is exploited to approximate the eigenvectors of n×n Gram matrix. In this paper we consider Nystrom method and its few modifications such as 'Nystrom KPCA ensemble' and 'Nystrom + randomized SVD' to improve the scalability of KPCA. We compare the performance of these methods in the task of learning face descriptors for face recognition.