首页> 外文会议>IEEE International Conference on Systems, Man, and Cybernetics >Acquiring a Broad Range of Empirical Knowledge in Real Time by Temporal-Difference Learning
【24h】

Acquiring a Broad Range of Empirical Knowledge in Real Time by Temporal-Difference Learning

机译:通过时间差异学习实时获得广泛的经验知识

获取原文

摘要

Several robot capabilities rely on predictions about the temporally extended consequences of a robot's behaviour. We describe how a robot can both learn and make many such predictions in real time using a standard algorithm. Our experiments show that a mobile robot can learn and make thousands of accurate predictions at 10 Hz. The predictions are about the future of all of the robot's sensors and many internal state variables at multiple time-scales. All the predictions share a single set of features and learning parameters. We demonstrate the generality of this method with an application to a different platform, a robot arm operating at 50 Hz. Here, learned predictions can be used to measurably improve the user interface. The temporally extended predictions learned in real time by this method constitute a basic form of knowledge about the dynamics of the robot's interaction with the environment. We also show how this method can be extended to express more general forms of knowledge.
机译:几个机器人能力依赖于预测机器人行为的时间延长后果。我们描述了机器人如何使用标准算法实时学习和制作许多这样的预测。我们的实验表明,移动机器人可以在10 Hz中学习和制造数千个准确的预测。预测是关于所有机器人的传感器的未来和多个时间尺度的许多内部状态变量。所有预测共享一组特征和学习参数。我们通过应用于不同平台的应用程序展示了这种方法的一般性,机器人臂以50 Hz运行。这里,学习的预测可用于可测量地改善用户界面。通过该方法实时学习的时间延长预测构成了关于机器人与环境互动的动态的基本知识形式。我们还展示了如何扩展该方法以表达更一般的知识形式。

著录项

相似文献

  • 外文文献
  • 中文文献
  • 专利
获取原文

客服邮箱:kefu@zhangqiaokeyan.com

京公网安备:11010802029741号 ICP备案号:京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有
  • 客服微信

  • 服务号