首页>
外国专利>
Optimization of model generation in deep learning neural networks using smarter gradient descent calibration
Optimization of model generation in deep learning neural networks using smarter gradient descent calibration
展开▼
机译:使用智能梯度血统校准优化深学习神经网络模型生成
展开▼
页面导航
摘要
著录项
相似文献
摘要
In training a new neural network, batches of the new training dataset are generated. An epoch of batches is passed through the new neural network using an initial weight (θ). An area minimized (Ai) under an error function curve and an accuracy for the epoch are calculated. It is then determined whether a set of conditions are met, where the set of conditions includes whether Ai is less than an average area (A_avg) from a training of an existing neural network and whether the accuracy is within a predetermined threshold. When the set of conditions are not met, a new θ is calculated by modifying a dynamic learning rate (β) by an amount proportional to a ratio of Ai/A_avg and by calculating the new θ using the modified β according to θ:±θ−; The process is repeated a next epoch until the set of conditions are met.
展开▼