A note on the expressive power of deep rectified linear unit networks in high-dimensional spaces

摘要

We investigate the ability of deep deep rectified linear unit (ReLU) networks to approximate multivariate functions. Specially, we establish the approximation error estimate on a class of bandlimited functions; in this case, ReLU networks can overcome the "curse of dimensionality."