Residual of Resonant SVD as Salient Feature

摘要

Computer vision approaches to saliency are based, among others, on uniqueness [1], local complexity [2], distinctiveness [3,4], spectral variation [5], and irregularity [6]. Saliency can also be viewed as the information in the data relative to a representation or model [7]. When a representation is built, a residual error is often minimised. The residual can be used to obtain saliency maps for solving challenging tasks of image and video processing. We introduce the notion of the resonant SVD and demonstrate that the SVD residual at the resonant spacing is selective to defects in spatially periodic surface textures and events in time-periodic videos. Examples with real-world images and videos are shown and discussed.