Human figure control software for real-virtual application

摘要

We present human figure control software using vision-based human motion capturing. We have already developed core techniques for vision-based human motion tracking and motion synthesis. We have provided the first version software as an open source kit. In this work, we have developed the second version software with modified motion synthesis. Our software consists of the following software: the vision software (includes 2D blob tracking modules and stereo vision module) and the motion synthesis software (includes skeletal structure reconstruction from a limit number of 3D positions, i.e., physically simulated joint position estimator). This software can be employed for many real-virtual applications such as avatar based video conferencing, virtual human control, and 3D game consoles which need the user postures as input. Our software requires the following hardware: more than two firewire cameras for vision processing and more than one PC for vision processing, motion synthesis, and rendering. In our real-virtual system, this software is also employed for virtual object manipulation interface with augmented avatar representation.