Experiment on Object Recognition with Haptic, Olfactory, and Auditory Senses in Virtual Environment

摘要

In this report, we carry out an experiment to investigate how much correctly 3D objects are recognized with haptic, olfactory and auditory senses in a virtual environment by using our object recognition system. In the system, we can touch each of 16 objects which are different from each other in shape and softness by using a haptic interface device. Some of the objects have sounds or smells, and we can perceive the sounds and smells by using a headphone and an olfactory display, respectively. Experimental results show how much largely the recognition accuracy can be increased by adding the sounds or smells to the objects.