Multimodal image perception system and method

摘要

A real-time multimodal image perception system to transform the standard lab blood smear image for persons with BVI to perceive, employing a combination of auditory, haptic, and vibrotactile feedbacks. These sensory feedbacks are used to convey visual information in appropriate perceptual channels, thus creating a palette of multimodal, sensorial information. A Bayesian network is provided to characterize images through two groups of features of interest: primary and peripheral features. A method is provided for optimal matching between primary features and sensory modalities.