Hybrid fusion and demosaicing algorithm with near-infrared image

摘要

In this paper, we propose a unified framework for color filter array (CFA) interpolation and visible/NIR image combination. The proposed method aims to reconstruct a high quality image from raw CFA data and the corresponding NIR image, similar to a multi-spectral fusion of color and NIR images. Based on NIR image, we impose a sparse constraint of gradient difference to modify the traditional color interpolation. The experiments indicate the effectiveness of our hybrid scheme to acquire joint color and NIR information in real-time, and show that this hybrid process can generate a better color image when compared with treating interpolation and fusion separately.