ump: Virtual Reality Video

摘要

We present Jump, a practical system for capturing high resolution,rnomnidirectional stereo (ODS) video suitable for wide scale consumptionrnin currently available virtual reality (VR) headsets. Ourrnsystem consists of a video camera built using off-the-shelf componentsrnand a fully automatic stitching pipeline capable of capturingrnvideo content in the ODS format. We have discovered and analyzedrnthe distortions inherent to ODS when used for VR display as wellrnas those introduced by our capture method and show that they arernsmall enough to make this approach suitable for capturing a widernvariety of scenes. Our stitching algorithm produces robust resultsrnby reducing the problem to one of pairwise image interpolationrnfollowed by compositing. We introduce novel optical flow and compositingrnmethods designed specifically for this task. Our algorithmrnis temporally coherent and efficient, is currently running at scale onrna distributed computing platform, and is capable of processing hoursrnof footage each day.