Are unsupervised neural networks ignorant? Sizing the effect of environmental distributions on unsupervised learning

摘要

Learning environmental biases is a rational behavior: by using prior odds, Bayesian networks rapidly became a benchmark in machine learning. Moreover, a growing body of evidence now suggests that humans are using base rate information. Unsupervised con-nectionist networks are used in computer science for machine learning and in psychology to model human cognition, but it is unclear whether they are sensitive to prior odds. In this paper, we show that hard competitive learners are unable to use environmental biases while recurrent associative memories use frequency of exemplars and categories independently. Hence, it is concluded that recurrent associative memories are more useful than hard competitive networks to model human cognition and have a higher potential in machine learning.