首页> 外国专利> METHOD FOR IMPROVING NEURAL NETWORK ARCHITECTURES USING EVOLUTIONARY ALGORITHMS

METHOD FOR IMPROVING NEURAL NETWORK ARCHITECTURES USING EVOLUTIONARY ALGORITHMS

机译:进化算法的神经网络架构改进方法

摘要

sets or evaluation on sets among the evaluated neural networks may cause potentially worthwhile architectures to be rejected prematurely, obviating the advantages realizable by a directed trial and error process. It is an object of this invention to provide a method for improving neural network architectures via an evolutionary algorithm that reduces the adverse effects of the noise that is introduced by the network initialization process. It is a further object of this invention to reduce the noise that is introduced by the network initialization process. It is a further object of this invention to provide an optimized network initialization process. It is a further object of this invention to reduce the noise that is introduced by the use of randomly selected training or evaluation input sets. ;These objects and others are achieved by including parameters that affect the initialization of a neural network architecture within the encoding that is used by an evolutionary algorithm to optimize the neural network architecture. The example initialization parameters include an encoding that determines the initial nodal weights used in each architecture at the commencement of the training cycle. By including the initialization parameters within the encoding used by the evolutionary algorithm, the initialization parameters that have a positive effect on the performance of the resultant evolved network architecture are propagated and potentially improved from
机译:评估神经网络中的集合或集合上的评估可能会导致潜在有价值的架构过早地被拒绝,从而消除了通过有序的试错法可实现的优势。本发明的目的是提供一种用于通过进化算法来改善神经网络架构的方法,该算法减少了由网络初始化过程引入的噪声的不利影响。本发明的另一个目的是减少由网络初始化过程引入的噪声。本发明的另一个目的是提供一种优化的网络初始化过程。本发明的另一个目的是减少通过使用随机选择的训练或评估输入集而引入的噪声。 ;这些目标和其他目标通过在编码中包含影响神经网络体系结构初始化的参数来实现,而进化算法使用该参数来优化神经网络体系结构。示例初始化参数包括一种编码,该编码确定在训练周期开始时每个体系结构中使用的初始节点权重。通过将初始化参数包含在进化算法使用的编码中,可以传播对最终的进化网络体系结构的性能产生积极影响的初始化参数,并可能从以下方面进行改进

著录项

相似文献

  • 专利
  • 外文文献
  • 中文文献
获取专利

客服邮箱:kefu@zhangqiaokeyan.com

京公网安备:11010802029741号 ICP备案号:京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有
  • 客服微信

  • 服务号