Expansion of multi-viewpoint image data including composite objects using IMU and image data

摘要

Mechanisms and processes are provided for extending multi-view image data including composite objects using an inertial measurement unit (IMU) and image data. In one example, the process includes receiving a selection of anchor positions in the reference image for a composite object to be placed in the multi-view image. Motion between the reference image and the target image is calculated using visual tracking information associated with the multi-view image, device orientation corresponding to the multi-view image, and camera intrinsic parameter estimates. Then, the visual tracking information is used in the multi-viewpoint image to place the composite object at the anchor position, the reverse of the motion calculated between the reference image and the target image is used to orient the composite object, and the target image A first composite image is generated by projecting the composite image along a half line to the target view associated with. The first composite image is superimposed on the target image to generate an extended image from the target view.