Apparatus and method to represent mixed reality space shared by plural operators, game apparatus using mixed reality apparatus and interface method thereof

摘要

This invention provides a mixed reality apparatus and mixed reality presentation method, which can present reality even when a plurality of players share a common mixed reality space. Virtual objects (41 - 47) are superposed to hide devices such as an HMD and the like that another player wears. In addition, there is disclosed a user interface apparatus to which the user (player) can easily sensuoulsy become accustomed, and which can accurately recognize instructions (commands) that the user (player) intended. The user interface apparatus has a location/posture sensor (150) attached to the head of the user, and a location/posture sensor (151) attached to his or her hand, analyzes hand action on the basis of the relative position of the location/posture of the hand with respect to those of the head, and estimates the current action state from the analysis result. The apparatus then determines a user instruction (player command) on the basis of the action state.