APPARATUS AND METHOD OF FIVE DIMENSIONAL (5D) VIDEO STABILIZATION WITH CAMERA AND GYROSCOPE FUSION

摘要

An apparatus and method of five dimensional (5D) video stabilization with camera and gyroscope fusion are herein disclosed. According to one embodiment, an apparatus includes a feature matcher configured to receive an image sequence and determine feature pairs in the image sequence; a residual two-dimensional (2D) translation estimator connected to the feature matcher and configured to determine a raw 2D translation path; a residual 2D translation smoother connected to the residual 2D translation estimator and configured to determine a 2D smoothed translation path; a distortion calculator connected to the residual 2D translation estimator and the residual 2D translation smoother and configured to determine a distortion grid; and a distortion compensator connected to the distortion calculator and configured to compensate for distortion in the image sequence.