Intelligent fusion middleware for spatially-aware or spatially-dependent hardware devices and systems

摘要

Methods, including computer programs encoded on a computer storage medium, for controlling a 3D modeling application based on natural user input received at middleware. In one aspect, a method includes: receiving data indicating that an application operating at the application layer is interpreted as spatial data about one or entities at one or more corresponding locations within an environment context from one or more participating systems; receiving, through an interface in communication with the one or more systems that provide spatial data, multiple sets of spatial data provided by or derived from the one or more participating systems that are generated while the application manages one or more interactions in the environment context; determining adjustment to apply to the environment context.