Designing multilayer feedforward neural networks using simplified sigmoid activation functions and one-powers-of-two weights

摘要

A design method for multilayer feedforward neural networks with simplified sigmoid activation functions and one-powers-of-two weights is proposed. The designed multilayer feedforward neural network can retain a nearly identical generalisation capability of the corresponding network using continuous weights, while having increased computational speed in applications and reduced cost in digital hardware implementation.