Large space dimension Reinforcement Learning for Robot Position/Force Discrete Control

摘要

In this work a large space dimension reinforcement learning (RL) approximation is developed for a Discrete Impedance Position/Force control of robot manipulators that interacts with an unknown environment model. The Q-value function is designed in the sense of optimal control theory. The approximator is based on normalized radial basis functions (NRBFs), and are built using the K-means clustering algorithm which generates a family of approximators for the Q-value function. The RL algorithms learn on-line the optimal impedance model which is equivalent to the desired force without any prior knowledge of the environment dynamics; this feeds a force controller and its output feeds the position controller. Real time experiments are shown using a 2 degree of freedom (DOF) pan and tilt robot and a 6-DOF force/torque (F/T) sensor.