Spatial–Spectral Relation Network for Hyperspectral Image Classification With Limited Training Samples

摘要

Due to the data-hungry nature of deep neural networks and the high dimensionality of hyperspectral imagery (HSI) data, the scarcity of training samples remains a significant challenge for HSI classification based on deep learning. Recently, the pairing or recombining of samples has proven to be an efficient approach to increase the amount of input training data, and accordingly, the architecture of a network trained by these samples has to be redesigned, since the input is no longer a single sample. Following this strategy, in this article, we propose a spatial-spectral relation network (SS-RN) for HSI classification with limited training samples. The SS-RN takes advantage of the relation network architecture to precisely capture the profound similarity between samples. Additionally, to make SS-RN more suitable for HSI classification, an entire three-dimensional (3-D) neighborhood instead of the isolated pixel is considered to explore both spectral and spatial information thoroughly. Multiple support samples are also selected for each class to make sure that the extracted features are stable enough to avoid the intraclass similarity and interclass dissimilarity problem of HSI. The network is composed on the basis of 3-D convolutional neural network blocks with the aim of extracting spatial-spectral features. Extensive experiments on three widely used HSI datasets demonstrate that the proposed method can achieve better classification accuracy than conventional deep learning methods with limited labeled training samples.