首页>
外国专利>
LEARNING LONGER-TERM DEPENDENCIES IN NEURAL NETWORK USING AUXILIARY LOSSES
LEARNING LONGER-TERM DEPENDENCIES IN NEURAL NETWORK USING AUXILIARY LOSSES
展开▼
机译:利用辅助损失学习神经网络中的长期依赖
展开▼
页面导航
摘要
著录项
相似文献
摘要
Methods, systems, and apparatus, including computer programs encoded on computer storage media, for structuring and training a recurrent neural network. This describes a technique that improves the ability to capture long term dependencies in recurrent neural networks by adding an unsupervised auxiliary loss at one or more anchor points to the original objective. This auxiliary loss forces the network to either reconstruct previous events or predict next events in a sequence, making truncated backpropagation feasible for long sequences and also improving full backpropagation through time.
展开▼