Virtual Face-to-Face Communication System for Human Interaction Analysis by Synthesis

摘要

In this paper, an embodied virtual face-to-face communication system for human interaction analysis by synthesis was developed, and the effectiveness of the system was demonstrated. The system provides virtual communication environments where two remote talkers communicate through their virtual actors (VAs) or virtual waves (VWs) representing their face-to-face interactive behavior on the basis of their motions and voices. Talkers can obtain interaction awareness by observing their interaction of VAs or VWs including themselves in the same virtual space. In the system, even if the time lags of data transmission exist in network, the temporal interaction relation of VAs keeps natural because each behavior of VA is delayed in the same way in the same space. Thus, this system is quite unlike the conventional telecommunication systems where the communication space between talkers is separated because only the partner to talk to is displayed. The system would be expected to form the foundation of information media and communication technologies as well as the methodology for the analysis and understanding of various human interactions.