Development for 3D Video Communication System by Using Kinect and Head Mount Display in the AR Space

摘要

Existing video communication systems, used in private business or video teleconference, show a part of the body of users on display only. This situation does not have realistic sensation, because showing a part of body on display does not make users feel communicating with others close to each other. It rather makes them feel communicating with the others who are far away. Furthermore, although these existing communication systems have file transfer function such as sending and receiving file data, it does not use intuitive manipulation. It uses mouse or touching display only. In order to solve these problems, we propose 3D communication system supported by Kinect and HMD (Head Mount Display) to provide users communications with realistic sensation and intuitive manipulation. This system is able to show whole body of users on HMD as if they were in the same room by 3D reconstruction. It also enables users to transfer and share information by intuitive manipulation to virtualized objects toward the other users. The result of this paper is a system that extracts human body by using Kinect, reconstructs extracted human body on HMD, and also recognizes users' hands to be able to manipulate AR objects by a hand.