A Dual-Branch Attention fusion deep network for multiresolution remote-Sensing image classification

摘要

In recent years, with the diversification of acquisition methods of very high resolution panchromatic (PAN) and multispectral (MS) remote sensing images, multiresolution remote sensing classification has become a research hotspot. In this paper, from the perspective of data-driven deep learning, we design a dual-branch attention fusion deep network (DBAF-Net) for the multiresolution classification. It aims to integrate the feature-level fusion and classification into an end-to-end network model. In the process of establishing a training sample library, unlike the traditional pixel-centric sampling strategy with fixed patch size, we propose an adaptive center-offset sampling strategy (ACO-SS), which allows each patch to adaptively determine the neighborhood range by finding the texture structure of the pixel to be classified. And the neighborhood range is not symmetrical with this pixel, we expect to capture the neighborhood information that is more conducive to its classification. In network structure, based on the captured patches by ACO-SS, we design a spatial attention module (SA-module) for PAN data and a channel attention module (CA-module) for MS data, thus highlighting the spatial resolution advantages of PAN data and the multi-channel advantages of MS data, respectively. Then these two features are interfused to improve and strengthen the fusion features in both spatial and channel. The quantitative and qualitative experimental results verify the robustness and effectiveness of the proposed method.