How to search in MPEG-7 based semantic descriptions:an evaluation of metrics

摘要

MPEG-7 is an extensive multimedia metadata standard covering an impressive range of aspects of metadata. However, as with most metadata standards details of usage and application of the standards are-at least partially-by design open to interpretation. In case of MPEG-7, storage and transmission of high level metadata on concept level are well defined but retrieval methods are not proposed by the standard. So if for instance a user annotates photos using the MPEG-7 semantic description scheme, there are no standardized ways to index and retrieve the photos based on the annotation. In this article we revisit metrics for relevance assessment based on the MPEG-7 Semantic Description Scheme in the context of information retrieval. We evaluate them in a digital photo retrieval scenario and investigate correlation of similarity and distance metrics to user perception in a user study.