An Annotation Method and Application for Video Contents Based on a Semantic Graph

摘要

The progress of digitization at broadcasting stations enables the intellectual production of high-quality contents from video materials. Metadata plays an important role in describing the semantics of multimedia contents by aiding in the semantic structuralization of video material. In this paper, we propose an annotation method for video contents based on the concept of a semantic graph, which allows semantic queries on video contents. This method incorporates three ideas: an annotation for metadata on video scenes; time-series links between video scenes; and semantic links to external data. In the proposed annotation method, metadata are provided as human annotations practical for TV productions. We also present the application of a semantic graph to real baseball game contents and evaluate this application to show the usefulness of the proposed annotation method.