Multimodal Surrogates for Video Browsing

摘要

Three types of video surrogates - visual (key-frames), verbal (keywords/phrases), and visual and verbal - were designed and studied in a qualitative investigation of user cognitive processes. The results favor the combined surro-gates in which verbal information and images reinforce each other, lead to better comprehension, and may actually require less processing time. The results also highlight image features users found most helpful. These findings will inform the interface design and video representation for video retrieval and browsing.