Image Understanding Systems Based on The Unifying Representation Of Perceptual and Conceptual Information and The Solution of Mid-level and High-level Vision Problems

摘要

Vision is a part of a larger information system that converts visual information into knowledge structures. These structures drive vision process, resolving ambiguity and uncertainty via feedback, and provide image understanding, that is an interpretation of visual information in terms of such knowledge models. A computer vision system based on such principles requires unifying representation of perceptual and conceptual information. Computer simulation models are built on the basis of graphsetworks. The ability of human brain to emulate similar graphetworks models is found. That means a very important shift of paradigm in our knowledge about brain from neural networks to the "cortical software". Starting from the primary visual areas, brain analyzes an image as a graph-type spatial structure. Primary areas provide active fusion of image features on a spatial grid-like structure, where nodes are cortical columns. The spatial combination of different neighbor features cannot be described as a statistical/integral characteristic of the analyzed region, but uniquely characterizes such region itself. Spatial logic and topology naturally present in such structures. Mid-level vision processes like clustering, perceptual grouping, multilevel hierarchical compression, separation of figure from ground, etc. are special kinds of graphetwork transformations. They convert low-level image structure into the set of more abstract ones, which represent objects and visual scene, making them easy for analysis by higher-level knowledge structures. Higher-level vision phenomena like shape from shading, occlusion, etc. are results of such analysis. Such approach gives opportunity not only to explain frequently "unexplainable" results of the cognitive science, but also to create intelligent computer vision systems that simulate perceptional processes ha both "what" and "where" visual pathways. Such systems can open new horizons for robotic and computer vision industries.