MIXED REALITY-BASED REMOTE OPERATION GUIDANCE SYSTEM AND METHOD

摘要

A mixed reality-based remote operation guidance system and method. The system comprises an AR client, a VR client, and a central server. The AR client transmits a collected on-site video to the VR client by means of a network, for rendering a video stream to an interactive virtual plane in a three-dimensional space. The VR client transmits, to the central server by means of the network, content annotated on the virtual plane by an expert, for fusion of virtual annotation and an on-site three-dimensional reconstruction model. The central server transmits fused data to the AR client by means of the network, for implementing fusion display with a physical space. The method can eliminate information blind spots in remote operation guidance, and solve the problem that complex operation guidance intentions cannot be accurately and visually expressed due to a single interaction mode and low interaction dimension in the remote operation guidance.