Ray-Space Processing for Omnidirectional FTV

摘要

FTV (Free-viewpoint Television) enables users to view a 3D scene by freely changing the viewpoint as if they were actually there. FTV is developed based on ray-space representation. Omnidirectional FTV is an FTV with very wide field of view (FOV), that is 360-degree FOV. 4D spherical ray-space is analyzed and applied to omnidirectional FTV. 4D spherical ray-space of "a group of rays through one point" is derived. It is extended to ray-space captured by many cameras on a circle. View generation of omnidirectional FTV needs rays that are not captured by real cameras. These rays are synthesized by interpolating the captured ray-space. It is done so that the intersections of the captured ray-space and the ray-space of rays emitted from a light source have the same color. Omnidirectional FTV with full parallax is realized by using the 4D ray-space processing.