Quadratic Hadamard Memories II. Adaptive Stochastic Content. Addressable Memory

摘要

This report is the second part of an investigation of the so called 'DominantLabel Selector', (DLS) which is the rear stage of a novel associative memory called 'Selective Reflexive Memory' (SRM). The front stage of the SRM consists of a Bidirectional Linear Transformer (BLT) the output of which is processed by the DLS. The BLT transforms a bipolar input x into a linear combination of Hadamard vectors, and the task of the DLS is to select the dominant Hadamard vector from this linear combination. This vector is then returned to the BLT for a back stroke, which produces the stored vector closest to x. An attractive choice of DLS is the 'Quadratic Hadamard Memory', which employs quadratic activations, and stores Hadamard vectors. Previously, this DLS was investigated by means of the asynchronous discrete model. In this report the investigation of the Quadratic Hadamard Memory is extended to the continuous model in which input capacitance and resistance of amplifiers is accounted for, and the coupling between BLT and DLS can be studied. (KR)