Arbitrary view generation system based on silhouette detection from color and disparity images

摘要

In this paper, we describe the arbitrary view generation system from multiple view images using octree and silhouette. Our system consists of four calibrated cameras. Each camera is connected to a PC that locally extracts the silhouettes from the image captured by the camera. The four silhouette images and camera images are then sent to host computer to perform 3D reconstruction. For making the reconstruction faster, the object 3D space is represented by octree structure. We develop a new algorithm for fast speed constructing octree. The algorithm can reduce time complexity to check if a node should project 8 cube vertices to image plane, using a stack that keeps parents' temporary cube type. After reconstruction of model, we render arbitrary view images with coloring all voxels included the parts of surface in the model. By using our algorithm, our system runs in semi real time computation, (about 5 frames per second) for generating arbitrary view image.