This paper proposes a novel real-time nonverbal communication system from natural language instruction by introducing an artificial intelligence method into the networked virtual environment (NVE). We extract semantic information as an interlingua from input text by natural language processing, and then transmit this semantic feature extraction (SFE) that actually is a parameterized action representation to the 3-D articulated humanoid models prepared in each client. Experiments between Japanese sign language (JSL) and Chinese sign language (CSL) show this system makes the teal-time animations of avatars available for the participants.
展开▼
