首页>
外国专利>
DIFFERENTIABLE SET TO INCREASE THE MEMORY CAPACITY OF RECURRENT NEURAL NETWORKS
DIFFERENTIABLE SET TO INCREASE THE MEMORY CAPACITY OF RECURRENT NEURAL NETWORKS
展开▼
机译:增加递归神经网络记忆容量的不同方法
展开▼
页面导航
摘要
著录项
相似文献
摘要
According to embodiments, a recurrent neural network (RNN) is equipped with a set data structure whose operations are differentiable, which data structure can be used to store information for a long period of time. This differentiable set data structure can “remember” an event in the sequence of sequential data that may impact another event much later in the sequence, thereby allowing the RNN to classify the sequence based on many kinds of long dependencies. An RNN that is equipped with the differentiable set data structure can be properly trained with backpropagation and gradient descent optimizations. According to embodiments, a differentiable set data structure can be used to store and retrieve information with a simple set-like interface. According to further embodiments, the RNN can be extended to support several add operations, which can make the differentiable set data structure behave like a Bloom filter.
展开▼