Hierarchical Modeling of Local Image Features through L_p-Nested Symmetric Distributions

摘要

We introduce a new family of distributions, called L_p-nested symmetric distributions, whose densities are expressed in terms of a hierarchical cascade of L_p-norms. This class generalizes the family of spherically and L_p-spherically symmetric distributions which have recently been successfully used for natural image modeling. Similar to those distributions it allows for a nonlinear mechanism to reduce the dependencies between its variables. With suitable choices of the parameters and norms, this family includes the Independent Subspace Analysis (ISA) model as a special case, which has been proposed as a means of deriving filters that mimic complex cells found in mammalian primary visual cortex. L_p-nested distributions are relatively easy to estimate and allow us to explore the variety of models between ISA and the L_p-spherically symmetric models. By fitting the generalized L_p-nested model to 8 × 8 image patches, we show that the subspaces obtained from ISA are in fact more dependent than the individual filter coefficients within a subspace. When first applying contrast gain control as preprocessing, however, there are no dependencies left that could be exploited by ISA. This suggests that complex cell modeling can only be useful for redundancy reduction in larger image patches.