首页> 外国专利> AUTONOMOUS AND CONTINUOUSLY SELF-IMPROVING LEARNING SYSTEM

AUTONOMOUS AND CONTINUOUSLY SELF-IMPROVING LEARNING SYSTEM

机译:自主不断自我完善的学习系统

摘要

A system and methods are provided in which an artificial intelligence inference module identifies targeted information in large-scale unlabeled data, wherein the artificial intelligence inference module autonomously learns hierarchical representations from large-scale unlabeled data and continually self-improves from self-labeled data points using a teacher model trained to detect known targets from combined inputs of a small hand labeled curated dataset prepared by a domain expert together with self-generated intermediate and global context features derived from the unlabeled dataset by unsupervised and self-supervised processes. The trained teacher model processes further unlabeled data to self-generate new weakly-supervised training samples that are self-refined and self-corrected, without human supervision, and then used as inputs to a noisy student model trained in a semi-supervised learning process on a combination of the teacher model training set and new weakly-supervised training samples. With each iteration, the noisy student model continually self-optimizes its learned parameters against a set of configurable validation criteria such that the learned parameters of the noisy student surpass and replace the learned parameter of the prior iteration teacher model, with these optimized learned parameters periodically used to update the artificial intelligence inference module.
机译:本发明提供了一种系统和方法,其中人工智能推理模块识别大规模未标记数据中的目标信息,其中,人工智能推理模块自学习大规模未标记数据的层次表示,并使用经过训练的教师模型从自标记数据点不断自我改进,以从领域专家准备的小型手动标记管理数据集的组合输入以及自生成的中间和全局上下文中检测已知目标通过无监督和自我监督的过程从未标记的数据集派生的特征。经过训练的教师模型进一步处理未标记的数据,以自生成新的弱监督训练样本,这些样本在没有人工监督的情况下进行自我精炼和自我校正,然后用作在半监督学习过程中结合教师模型训练集和新的弱监督训练样本训练的噪声学生模型的输入。在每次迭代中,有噪声的学生模型根据一组可配置的验证标准不断地自我优化其学习参数,以便有噪声的学生的学习参数超过并替换先前迭代教师模型的学习参数,这些优化的学习参数定期用于更新人工智能推理模块。

著录项

  • 公开/公告号US2022138509A1

    专利类型

  • 公开/公告日2022-05-05

    原文格式PDF

  • 申请/专利权人 DOCBOT INC.;

    申请/专利号US202117408283

  • 发明设计人 PETER CROSBY;JAMES REQUA;

    申请日2021-08-20

  • 分类号G06K9/62;G06N20;

  • 国家 US

  • 入库时间 2022-08-25 00:49:54

相似文献

  • 专利
  • 外文文献
  • 中文文献
获取专利

客服邮箱:kefu@zhangqiaokeyan.com

京公网安备:11010802029741号 ICP备案号:京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有
  • 客服微信

  • 服务号