Method and system for driving simulated virtual environments with real data

摘要

A method and a processing pipeline for driving a simulated virtual environment with real data are described. The method is described with regard to visualization and interaction with real and virtual data in simulated virtual environments. The method for driving a simulated virtual environment with real data comprises providing a simulated virtual environment including a plurality of virtual objects in a virtual scene, providing captured data related to one or more real objects of a real scene to the virtual environment, assigning the captured data to corresponding virtual objects, updating the plurality of virtual objects in the virtual scene, and rendering the virtual scene of the simulated virtual environment, wherein the virtual scene is rendered in real-time with regard to providing the captured data. A system for driving a simulated virtual environment with real data is also described.