首页> 外国专利> PARAMETER UPDATE METHOD DEVICE AND ELECTRONIC EQUIPMENT FOR MULTITASK MODEL

PARAMETER UPDATE METHOD DEVICE AND ELECTRONIC EQUIPMENT FOR MULTITASK MODEL

机译:参数更新方法设备和多任务模型的电子设备

摘要

The present application discloses a parameter update method, apparatus and electronic device of a multi-task model, and relates to the field of computer technology, in particular, to the field of deep learning and artificial intelligence. A specific implementation method is to obtain a training sample set; sequentially putting each sample into a corresponding sample queue according to the task to which each sample belongs; Under the condition that the number of samples in the random sample sequence reaches the training data demand, using the data in the random sample sequence, the shared network layer in the multitask model and the target subnetwork layer corresponding to the task related to the random sample sequence are to train for generating a model parameter update gradient corresponding to a task related to an arbitrary sample sequence; and updating the parameters of the shared network layer and the target subnetwork layer in the parameter server according to the update hardness. Thus, through this parameter update method of the multitask model, when distributed training on the multitask model, local parameter update is implemented to improve the precision of the multitask model.
机译:本申请公开了一种多任务模型的参数更新方法,装置和电子设备,尤其涉及深度学习和人工智能领域的计算机技术领域。具体的实现方法是获得训练样本集;根据每个样本所属的任务顺序地将每个样本放入相应的样本队列;在随机样本序列中的样本数量的条件下,使用随机采样序列中的数据,多任务模型中的共享网络层和与随机样本相关的任务相对应的目标子网层序列是训练用于生成与与任意样本序列相关的任务相对应的模型参数更新梯度;根据更新硬度更新参数服务器中共享网络层和目标子网层的参数。因此,通过多任务模型的该参数更新方法,当在多任务模型上分布式训练时,实现了本地参数更新以提高多址模型的精度。

著录项

相似文献

  • 专利
  • 外文文献
  • 中文文献
获取专利

客服邮箱:kefu@zhangqiaokeyan.com

京公网安备:11010802029741号 ICP备案号:京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有
  • 客服微信

  • 服务号