Multisensor image fusion mining: from neural systems to COTS software

摘要

We summarize our methods for the fusion of multisensor imagery based on concepts derived from neural models of visual processing and pattern learning and recognition. These methods have been applied to real-time fusion of night vision sensors in the field, airborne multispectral and hyperspectral imaging systems, and space-based multiplatform multimodality sensors. The methods enable color fused 3D visualization, as well as interactive exploitation and data mining in the form of human-guided machine learning and search for targets and cultural features. Over the last year we have developed a user-friendly system integrated into a COTS exploitation environment known as ERDAS Imagine. We demonstrate fusion and interactive mining of low-light Visible/SWIR/MWIR/LWIR night imagery, and IKONOS multispectral imagery. We also demonstrate how target learning and search can be enabled over extended operating conditions by allowing training over multiple scenes. This is illustrated for detecting small boats in coastal waters using fused Visible/MWIR/LWIR imagery.