Augmented reality annotations to assist persons with Alzheimers and their caregivers

摘要

Persons with Alzheimer's disease (AD) and their caregivers implement diverse strategies to cope with memory loss. A common strategy involves placing tags on drawers or removing cabinet doors to make their contents visible. This study describes the Ambient aNnotation System (ANS), aimed at assisting people suffering from AD and their caregivers with this task. The system has two main modules: The tagging subsystem allows caregivers to create and manage ambient annotations in order to assist people with memory problems. The second subsystem allows people with AD to use a mobile phone to recognize tags in the environment and to receive relevant information in the form of audio, text, or images. The identification of these tags is performed in real time by uploading images from the mobile phone to a server, which uses the SURF algorithm for object recognition. We describe the design and implementation of the system as well as results of the evaluation of its performance and efficiency. ANS can process query images approximately every 2 s and is able to locate users in their homes with a precision of 0.93. A usability study conducted with six subjects determined that audio notifications are more effective than vibrating notifications to alert the user about tags in the environment.