Design and Implementation of Virtual-Real Interactive System for Mixed Reality

摘要

Mixed reality (MR) combines real and virtual worlds to create an interactive bridge between the real world, the virtual world and users. In order to make the interaction between the user and the virtual world intelligent, a virtual-real interaction system for mixed reality scheme is proposed. This paper mainly discusses the technical solutions for implementing the system and demonstrates the interaction between the user and virtual characters in the interactive system. The virtual characters of the interactive system are stimulated by real and virtual scenes, and the behavior of real people changes [1]. The modules used in this study include: 1) Unreal Engine 4 builds virtual scenes and characters, 2) Motion capture system captures real-world information, aligns real and virtual worlds. Alignment refers to the same position information and orientation information of the real world and the virtual world. 3) Graphics workstation synthesizes scenes captured by optical cameras and virtual scenes.