A METHODOLOGY FOR AUTOMATICALLY ANNOTATING IMAGES BY CONVERTING THEM INTO NL TEXT SENTENCES

摘要

The efficient processing, associating and understanding multimedia or multi-modal information is a very important research field with a great variety of applications, such as knowledge discovery, document understanding, human computer interaction, etc. An important issue is the development of a common platform for converting different modalities (such as images, text, etc.) into the same medium and associating them for efficient processing and understanding. Thus, this paper presents the development of a robust and efficient methodology capable of automatically converting images into natural language (NL) text sentences using image processing-analysis methods and graphs with attributes for object recognition and image understanding. Then it converts graph representations into NL text sentences. Simple illustrative examples are provided for proving the concept proposed here.