Seeing Virtual Objects: Simulating Reflective Surfaces on Emissive Displays

摘要

In this paper, we work toward creating display systems that can present virtual proofs and replicas that behave like real physical surfaces in the actual lighting environment surrounding the display. The goal is to recreate the experience of directly viewing a reflective surface while using self-luminous display screens. We use a computational approach that models the physical light sources and actively tracks the observer to generate simulated reflections that are consistent with the observer's real viewing position and the real lighting present. The spectral composition of the ambient illumination is interactively sensed and the surface colors are calculated with a real-time multispectral rendering pipeline to allow the rendered model to automatically update its color with changes in the real lighting.