Bayesian Image Matting Using Infrared and Color Cues

摘要

In this paper, we propose a new matting solution that combines the use of color and infrared cameras for matting applications involving human actors. The infrared camera facilitates the extraction of the initial trimap and provides additional information for the matte estimation. The approach proposed in this paper differs from the techniques proposed in the literature in many aspects. It employs thermal information for human actors, which proves to be useful and effective for matting when combined with color information. It also introduces a new technique for automatic trimap construction that is based on the temperature's difference between the foreground actor and the background objects. Finally, the matting step is carried out using a Bayesian approach which combines the color and the infrared inputs into a single criterion. The matting results accuracy shows that our approach is capable of tackling digital image and video matting problems.