Multi-Modal Dialog Scene Detection Using Hidden Markov Models for Content-Based Multimedia Indexing

摘要

A class of audio-visual data(fiction entertainment: movies, TV series) is segmented into scenes, which contain dialogs, using a novel hidden Markov model-based (HMM) method. Each shot is classified using both audio track(via classification of speech, silence and music) and visual content (face and location information). The result of this shot-based classification is an audio-visual token to be used by the HMM state diagram to Achieve scene analysis.