New information theoretical approach for the storage capacities of the perceptron with binary weightsω{sub}i∈ E {0,1},{-1,+1} are presented. Our main ideas come from the introduction of the minimum distance "d" between input patterns, whichdominates the capacity of each neural networks. This approach by means of the new parameter "d" is completely different from the usual replica method in statistical physics, but it can succeed to obtain the almost same storage capacities as those by thereplica method. Moreover, this information theoretical approach has some advantages of providing easier and more intuitive understanding of the capacity and the distinguishable minimum distance which characterizes the neural networks.
展开▼
