3D Multi-Branch Encoder-Decoder Networks with Attentional Feature Fusion for Pulmonary Nodule Detection in CT Scans

摘要

Pulmonary nodule detection in low-dose computed tomography (CT) images is essential for early screening and treatment of lung cancer. Previous related researches based on deep convolutional neural networks generally rely on 2D or 2.5D components and only focus on the output feature information under a single receptive field. Considering the 3D nature of lung CT images and the performance limitation of state-of-the-art nodule detection methods, we develop a novel 3D multi-branch region proposal network with an encoder-decoder structure. Specifically, each parallel branch is designed with 3D residual blocks and U-Net-like structure to effectively extract multi-scale fusion features based on 3D spatial information of CT scans, and the strategies of varying receptive fields and sharing weight parameters are used to improve the sensitivity of the detection network to nodules with scale variation and maintain the original parameters. Besides, we propose a multi-scale attentional feature fusion module to better fuse high-resolution and semantically strong features and adaptively learn the inter-dependency information of different feature maps. Finally, we compare a dynamically scaled cross entropy loss and online hard example mining (OHEM) to combat the imbalance of positive and negative samples during training, which is aimed at assisting with network optimization. Our extensive experiments on publicly available CT scans obtained from LUNA16 and TianChi^{1competition dataset demonstrate that our method outperform state-of-the-art pulmonary nodule detection models.}