Recent results of Integrated Sensing and Processing using a programmable hyperspectral imaging sensor

摘要

In this paper we present an information sensing system which integrates sensing and processing resulting in the direct collection of data which is relevant to the application. Broadly, integrated sensing and processing (ISP) considers algorithms that are integrated with the collection of data. That is, traditional sensor development tries to come up with the "best" sensor in terms of SNR, resolution, data rates, integration time, etc... and traditional algorithm development tasks might wish to optimize probability of detection, false alarm rate, class separability, etc... For a typical Automatic Target Recognition (ATR) problem, the goal of ISP is to field algorithms which "tell" the sensor what kind of data to collect next and the sensor alters its parameters to collect the "best" information in order that the algorithm performs optimally. We demonstrate an ISP system which utilizes a near Infrared (NIR) Hadamard multiplexing imaging sensor. This prototype sensor incorporates a digital mirror array (DMA) device in order to realize a Hadamard multiplexed imaging system. Specific Hadamard codes can be sent to the sensor to realize inner products of the underlying scene rather than the scene itself. The developed ISP algorithm uses an ATR metric to send codes to the sensor in order to collect only the information relevant to the ATR problem. The result is a multiple resolution hyperspectral cube with full resolution where targets are present and less than full resolution where there are no targets. Essentially, this is compressed sensing.