Dynamically reconfigurable vision for intelligent sensing

摘要

This paper introduces our Dynamically Reconfigurable Vision (DRV) technology, and discusses the significant benefits afforded by this technology to law enforcement applications employing unattended sensor networks. Despite improvements in both data compression and transmission technologies in recent years, video bandwidth constraints continue to limit performance for vision systems employed in sensor networks. DRV seeks to reduce, as much as possible the amount of irrelevant spectral information that is collected, and thus to make more effective use of available bandwidth and computational resources than is possible with conventional imaging technology. This is acheived through the intelligent, dynamic allocation of spatial and temporal sensing resources in response to the dynamics of the scene itself. Minimization of irrelevant data in the video processing chain reduces local processing requirements and allows communication of more information in real-time over bandwidth-limited channels. This leads to a reduction in unit power consumption, complexity, cost, andsize - minimizing these system parameters is critical to the performance of unattended sensor systems and networks.We have developed a prototype DRV camera system that demonstrates the significant performance advantages of this technology. Our DRV system employs a real-time reconfigurable CMOS image sensor which supports multiple variable-resolution, independently-configurable windows per exposure and operates in a snapshot capture mode to minimize motion artifacts. Data is output through multiple sensor video ports to minimize readout time and to provide a local contrast enhancement capability. Multiple, time-correlated windows allow a single sensor to fulfill multiple requirements concurrently, such as intruder detection and object tracking. This imager is capable of reconfiguring itself within several microseconds upon demand. Frame-by-frame configurable parameters include frame rate, integration time, and parameters defining each of the windows. Also presented is a design for a very-low-power DRV system that is under development, as well as other planned future enhancements.