Multimodal Dialog in the Car: Combining Speech and Turn-And-Push Dial to Control Comfort Functions

摘要

In this paper, we address the question how speech and tangible interfaces can be combined in order to provide effective multimodal interaction in vehicles, taking into account the special requirements induced by the circumstances of driving. Speech is used to set the interaction context (determine the object as is to be manipulated) and a turn-and-push dial is used to manipulate/adjust. An experimental study is presented that measures the distraction induced by manual (conventional), speech-only, and multimodal interaction (combination of speech and turn-and-push dial). Results show that while subjects where able to perform more tasks in the manual condition, their driving was significantly safer while using speech-only or multimodal dialog. Supplemental contributions of this paper are descriptions of how a multimodal dialog manager as well as a driving simulation software are connected to the CAN (Controller Area Network) vehicle bus as well as how driver distraction caused by interacting with a system are measured using the standardized lane change task (LCT).