Detection and Retrieval of Captions in News Video

摘要

Generating semantically meaningful content of news video has been increasingly spotlighted. Captions in video include useful information for automatic annotation and indexing. Unfortunately, there are difficulties in retrieving captions for most real applications because of the following factors: low resolution characters and extremely complex backgrounds. This paper proposes a novel local mutation-based method to solve these problems. We detect and locate captions according to shape-regularity and connectivity of the local mutation region. The overall experimental results show that our approach is general, effective, real time and robust enough for caption detection and retrieval, and farther for use in news indexing.