Simultaneous geometry and color texture acquisition using asingle-chip color camera

摘要

Capturing 3-D geometry and the perfectly aligned color texture simultaneously is crucial for diverse fields including enter-tainment, target recognition, and computer graphics. However, it is very challenging for a conventional technique becauseof a number of problems related to color. Previous researchers rely heavily on using two cameras: a black-and-white(B/W)camera to measure the geometry, and a color camera to capture the color texture. However, aligning the color image withthe 3-D geometry point by point remains difficult. In this research, we propose a novel technique that uses a single-chipcolor camera to capture both geometry and color texture simultaneously. A projector projects B/W fringe patterns onto theobject, and a color camera captures the raw fringe images with Bayer mosaic patterns. A phase-shifting algorithm is usedfor our system because of one of its merits: retrieving phase pixel-by-pixel. Therefore, the intensity variations betweenneighboring pixels do not significantly affect the measurement. Moreover, the same set of fringe images is also used tocalculate the B/W texture image, which is further converted into a color image using a demosaicing algorithm. Therefore,the same set of fringe images are used to generate the 3-D geometry as well as the color texture image simultaneously. Ahardware system was developed to verify the performance of the proposed technique. Experiments demonstrated that thistechnique can successfully measure both geometry and color texture of the color objects.