Integrating 2D images into a display of a 3D reality mesh to recover lost context

摘要

In example embodiments, techniques are provided integrating 2D images into the display of a 3D reality mesh to recover lost context. A determinization is made whether there is level of detail (LOD) in the 3D reality mesh sufficient to provide full context for a desired view of the 3D reality mesh. When such a LOD does not exist, a subset of the source 2D images that intersect a view frustrum for the desired view is selected from the set of 2D images used to reconstruct the 3D reality mesh. The selected source 2D image is evaluated to determine if it would be visually appropriate for the desired view. If the selected source 2D image is determined to be visually appropriate, the 3D reality mesh is replaced with the selected source 2D image or a portion thereof.