Spatiotemporal alignment of multi-sensor aerial video sequences

摘要

This paper presents a method for spatiotemporal alignment of two video sequences recorded by aerial sensors using different modularity. It recovers the inter-video temporal synchronization and spatial transformation from two sequences of intra-video transformations between successive frames within each video. Since it needs no directly comparison of images across two videos, and the intra-video transformation is easy to obtain, the alignment is possible even when the two videos have very different appearances. We make best use of the geometry between rigidly connected aerial video sensors and the ground scene, treat the intra-video and inter-video spatial transformations as similar ones, and develop a simple alignment method. Both theoretical analysis and experimental results demonstrate the stability and efficiency advantages over previous methods.