Multi-frame super-resolution of image sequence with arbitrary motion patterns

摘要

A computer implemented method is provided for computing a two-way optical flow between a reference frame and one or more associated frames in an optical flow module. A forward warping operator and a backward warping operator can be generated between the reference frame and each of the one or more associated frames in a warping module. The forward warping operator and the backward warping operator provide motion compensation between the frames. Weights for each of the forward warping operators and the backward warping operators can be computed in a weight module. The weights correspond to uncertainty of motion estimation. A super resolution iteration algorithm can be calculated in a super-resolution iteration module.