Efficient Reconstruction of Light Fields for Consistently Augmented Reality Using Dense Multi-view Systems

摘要

In this paper, we study dense multi-view systems transmitting light fields beyond a visual obstruction as if itwere transparent. Multi-view 3d displays appropriately combined with camera arrays or lens arrays provideconsistently augmented reality for many users at the same time as a simple solution of such occlusion in thereal world. We first describe a design of our proposed multi-view system, appearances of which are evaluated byassuming state-of-the-art visual devices to be used. Then, in order to reduce image sensors acquiring light fieldsfor inexpensive systems, efficient interpolation is introduced to reconstruct the entire 4d light field in real timefor consistency with the real world. We show that our practical implementation on a GPGPU actually achievesreal-time interpolation obtaining enormous data of light fields without severe degradation for various depths.