Background image and mask estimation for accurate shift-estimation for video object detection in presence of misalignment

摘要

Disclosed herein are a method, system, and computer program product for aligning an input video frame from a video sequence with a background model associated with said video sequence. The background model includes a plurality of model blocks (820, 830), each one of the plurality of model blocks (820, 830) being associated with at least one mode (821, 822, 823, 831, 832, 833, 834), wherein each mode (821, 822, 823, 831, 832, 833, 834) includes a plurality of frequency domain attributes. The method selects, for each one of the plurality of model blocks, a reference mode dependent upon a mode of the corresponding model block, generates a background reference image (840) comprising the plurality of selected reference blocks (841, 842), and then aligns the input frame with the background model (810), based on the background reference image (810).