Improved method of image registration between frames and panoramic images using projective transform: for panorama-based annotation overlay

摘要

In this paper, we propose an improved method of annotation overlay on live video which is one of the most promising applications in augmented reality and wearable computer. In our previous work, we proposed the panorama-based method of annotation overlay which aligns an input video frame and a panoramic image using affine transform. However, affine transform is generally not capable of image registration between a frame and a panorama. We improved the previous method so that it can estimate projective transform parameters without severely increasing computational cost. We confirmed that improved method could estimate image registration parameters under conditions that hindered the previous method. Its computational cost increased only by 10--20% and its real-time processing with software implementation was achieved.