Decomposing Time-Lapse Paintings into Layers

摘要

The creation of a painting, in the physical world or digitally, is arnprocess that occurs over time. Later strokes cover earlier strokes,rnand strokes painted at a similar time are likely to be part of thernsame object. In the final painting, this temporal history is lost, andrna static arrangement of color is all that remains. The rich literaturernfor interacting with image editing history cannot be used. To enablernthese interactions, we present a set of techniques to decompose arntime lapse video of a painting (defined generally to include pencils,rnmarkers, etc.) into a sequence of translucent “stroke” images. Wernpresent translucency-maximizing solutions for recovering physicalrn(Kubelka and Munk layering) or digital (Porter and Duff “over”rnblending operation) paint parameters from before/after image pairs.rnWe also present a pipeline for processing real-world videos of paintingsrncapable of handling long-term occlusions, such as the painter’srnhand and its shadow, color shifts, and noise.