Nonverbal interfaces and perspective of them in the near future

摘要

General characteristics of nonverbal interfaces and the status quo and the perspective of research activities about them are described. Nonverbal modes used in the real world can be extended for use in the three scenes: 1) nonverbal communication with avatars of the companions to talk with, 2) nonverbal interaction with human-like agents and 3) manipulation of 3D virtual objects. These interfaces are easy to use and fast, and they minimize users' mental and physical effort. At present many researchers focus on gestures and gaze, but it is required to construct natural interaction environments that allow users to freely select favorite ones among many modes for communication and interaction with virtual humans and objects.