In this paper we describe a combined constructive/destructive approach for dynamic network configuration. Different from previous approaches we address dynamic network configuration for recurrent networks and for a real-world natural language task of semantic categorization. We show that dynamic network configuration can lead to architectures which are smaller and faster than static networks and which perform slightly better on generalization than static networks.
展开▼
