Caltech develop cognitive assistant for the blind using augmented reality

摘要

A team of researchers from Caltech have developed a Cognitive Augmented Reality Assistant (CARA) headset to help blind people navigate their surroundings (Liu et al. 2018). CARA identifies objects in a given space using computer vision, and then uses Microsoft's HoloLens to make the objects 'talk' to you and say their names so you know if there is a desk to your left or a wall in front of you.The pitch of the object's voice changes with your distance from it, such that the closer you are the higher the pitch becomes.