SymbolPath: A Continuous Motion Overlay Module for Icon-Based Assistive Communication

摘要

Augmentative and alternative communication (AAC) systems are often used by individuals with severe speech impairments. Icon-based AAC systems typically present users with arrays of icons that are sequentially selected to construct utterances, which are then spoken aloud using text-to-speech (TTS) synthesis. For touch-screen devices, users must lift their finger or hand to select individual icons and avoid selecting multiple icons at once. Because many individuals with severe speech impairments have concomitant limb impairments, repetitive and precise movements can be slow and effortful. The current work aims to enhance message formulation ease and speed by using continuous motion icon selection rather than discrete input. SymbolPath is an overlay module that can be integrated with existing icon-based AAC systems to enable continuous motion icon selection. Message formulation using SymbolPath consists of drawing a continuous path through a set of desired icons. The system then determines the most likely subset of desired icons on that path and rearranges them to form a meaningful and grammatical sentence. In addition to demonstrating the SymbolPath module, we plan to present usability data and discuss iterative modifications to the software.