Remotely controlling robotic platforms based on multi-modal sensory data

摘要

Method of remotely controlling robotic platform based on multi-modal sensory data comprising positioning 310 robot; communicatively coupling 312 robot to a remote control station; obtaining the sensory data 314 using two or more sensors of the robot, the data comprising at least two sensory response types; transmitting 320 at least a portion of the data; and receiving 330 at the robot remote control instructions from the station. The robot may be positioned in a confined space of a structure, which may be an aircraft wing. The sensory response types may be selected from a binocular stereoscopic vision type, a binaural stereophonic audio type, a force-reflecting haptic manipulation type, and a tactile type. Local control instructions may be generated 334 at the robot based on the data. The robot may perform 350 operations within the space based on the local or remote instructions, or a combination. Operations may include changing 350a position of the robot or removing 350f an object from the space; drilling 350b, installing 350c a fastener into, sealing 350d, painting 350e, or inspecting 350g the structure. Also provided is a remote control station for controlling a robotic platform using multi-modal sensory data.