Application of Computational Media Aesthetics Methodology to Extracting Color Semantics in Film

摘要

Using film grammar as the underpinning, we study the ex- traction of structures in video based on color using a wide configuration of clustering methods combined with existing and new similarity measures. We study the visualisation of these structures, which we call Scene-Cluster Temporal Charts and show how it can bring out the interweaving of different themes and settings in a film. We also extract color events that filmmakers use to draw/force a viewer's atten- tion to a shot/scene. This is done by first extracting a set of colors used rarely in film, and then building a probabilis- tic model for color event detection. We demonstrate with experimental results from ten movies that our algorithms are effective in the extraction of both scene-cluster tempo- ral charts and color events.