The Willful Marionette: Modeling Social Cognition Using Gesture-Gesture Interaction Dialogue

摘要

In this paper we describe a cognitive model for provoking gestural dialogue with humans, embodied in an interactive marionette. The cognitive model is a framework for the design and implementation of a gesture to gesture interaction. The marionette perceives gestures of humans using a Microsoft Kinect, reasons about perceived gestures to determine a response, and then performs the selected response gesture. This simple cognitive model: perceive-reason-perform, operates in a social context where humans interact with the marionette. The marionette was built as a 3D replica of a human body. The marionette's responses were designed using interaction design techniques such as body storming, gesture elicitation, and the "Wizard of Oz" method to provoke an emotional response from humans. Several user studies were conducted during and after the design process to guide the design goal of achieving an engaging and provocative interaction. These studies showed that participants were encouraged to engage in a gesture-based dialogue with the marionette, and that they perceived the system to possess a kind of intelligence.