In the paper we address the problem of comptation in recurrent neural networks (RNN). In the first part we provide a formal analysis of the dynamical behaviro of a RNN with a single self-recurrent unit in the hidden layer, show how such a RNN may be designed to perform an (unrestricted) counting task and describe a generalization of the counter network that performs binary stack operations.
展开▼
