Automatic Mosaicking of 360 degree Panorama in Video Surveillance

摘要

Recently, there has been an increasing interest in using panoramic images in surveillance and target tracking applications. With the wide availability of off-the-shelf, Web-based pan-tilt-zoom (PTZ) cameras and the advances of CPUs and Graphics Processing Units (GPUs), object tracking using mosaicked images that cover a scene of 360 deg in near real-time has become a reality. This report presents a system that automatically constructs and maps full-view panoramic mosaics to a cube-map from images captured from an active PTZ camera with 1-25x optical zoom. A hierarchical approach is used in storing and mosaicking multi-resolution images captured from a PTZ camera. Techniques based on scale-invariant local features and probabilistic models for verification are used in the mosaicking process. Our algorithm is automatic and robust in mapping each incoming image to one of the six faces of a cube with no prior knowledge of the scene structure. This work can be easily integrated to a surveillance system that wishes to track moving objects in its 360 deg surroundings.