Video compression system using a dense motion vector field and a triangular patch mesh overlay model

摘要

In a temporal sequence of digitized image frames of video signals, the spatial and temporal image gradients and the pixel-to-pixel motion vectors (dense motion vectors) are obtained between two consecutive image frames. A shape-adaptive triangular patch mesh model overlay is provided on the first image frame such that the location of node points of each patch is determined by the spatial image gradients of the first frame and the pixel-to-pixel motion vectors. A priority ranking of patches is established before determining the node point motion vectors. The node point motion vectors, representing the motion of each of the node points of the triangular mesh patches, are estimated by a linear least-squares solution to an affine transformation of the mesh overlay on the first frame into the second frame. Failure regions are identified and are revised in accordance with a data bit budget. All data are coded prior to transmission at a constant data bit rate by a sending unit to a receiving unit over a data link.