Real-Time Pixel Luminance Optimization for Dynamic Multi-Projection Mapping

摘要

Using projection mapping enables us to bring virtual worlds intornshared physical spaces. In this paper, we present a novel, adaptablernand real-time projection mapping system, which supports multiplernprojectors and high quality rendering of dynamic content onrnsurfaces of complex geometrical shape. Our system allows forrnsmooth blending across multiple projectors using a new optimizationrnframework that simulates the diffuse direct light transport ofrnthe physical world to continuously adapt the color output of eachrnprojector pixel. We present a real-time solution to this optimizationrnproblem using off-the-shelf graphics hardware, depth cameras andrnprojectors. Our approach enables us to move projectors, depth camerarnor objects while maintaining the correct illumination, in realtime,rnwithout the need for markers on the object. It also allowsrnfor projectors to be removed or dynamically added, and providesrncompelling results with only commodity hardware.