Preliminary evaluation of the multimodal interactive system for NAO robot

摘要

The proposed paper brings a description of the pilot version of the multimodal dialogue system for NAO humanoid robot. Designed system enables multimodal interaction with the user in such manner that it takes a speech input from the user and it answers by a combination of synthetic speech and gestures. The core of the system is an external dialogue manager, which interprets VoiceXML language. A pilot speech communication application was designed and a preliminary evaluation was performed using subjective methods. Results of the preliminary evaluation highlights importance of involving gestures into communication exchange. Moreover the paper brings a discussion of usage scenarios, where designed system can be used for educational purposes.