Robot controller and display device using augmented reality and mixed reality

摘要

Robot controller configured to support an operation of a user by effectively using both augmented reality and mixed reality techniques. The robot controller includes: a display device configured to display information generated by a computer so that the information overlaps with an actual environment, etc.; a position and orientation maintenance section configured to obtain a relative position and orientation between the display device and a robot included in the actual environment; a display control section configured to display a virtual model of the robot, etc. on the display device; an operation control section configured to operate the virtual model displayed on the display device; and a position and orientation determination section configured to determine the position and / or orientation of the robot using the position and / or orientation of the operated virtual model and using the relative position and orientation between the robot and the display device.