How Much Does Color Information Help Optical Flow Computation?

摘要

Optical flow is usually computed only on the basis of intensity information of images. Therefore, if we use color information in addition to the intensity, it is expected that more accurate optical flow can be computed. However, this intuition will be correct only when the following conditions are satisfied. First, the images should contain rich color variations. Moreover, it is also required that the image gradient of each color band differs in its direction. In this report, we empirically examined the difference of gradient directions on each band using 500 images, and evaluated quantitatively the advantage of using color information for optical flow computation.