STEREO-AWARE PANORAMA CONVERSION FOR IMMERSIVE MEDIA

摘要

Techniques are disclosed for conversion of panoramas between different panoramic projections, including stereoscopic panoramic projections. The pixels of one panoramic image are mapped to the pixels of another panoramic image using ray tracing so that the images can be combined without introducing visual distortions caused by mismatches in the optics of each image. The conversion is performed using a process for mapping one or more pixels of an output image to pixels of an input image by tracing a ray between the UV coordinates corresponding to each pixel in the images. The conversion process accounts for arbitrary projections and for arbitrary stereo camera rig configurations by using metadata that describe the projection and positioning of each image being combined. The origin of each ray is offset to account for the interpupillary distance between left and right images and to account for any rotation of the scene.