Method implemented by computer, system and product of the computer program to simulate the behavior of a hand that interacts with objects in a virtual environment.

摘要

A method implemented by computer to simulate the behavior of a hand that interacts with objects in a virtual environment, which comprises acquiring a skeleton (202) of a hand (300) using a hand tracking device (620); computing a hand (310) simulated with objects (222) in a virtual environment (220); establish a connection between the skeleton (214) of a simulated hand (310) and the skeleton (202) followed using connection energies (Ucrb); establish a simulated internal hand power (310) that takes into account skeletal joint constraints, skeleton-tissue connection, and nonlinear soft tissue deformation; establishing a friction contact between the simulated hand (310) and the virtual objects using a penalty energy considering the relative interpenetration at contact points and a friction energy considering the deviation between each contact point and its corresponding sliding anchor point; compute an updated skeleton (214) and a simulated hand tissue (216) (310) minimizing the total energy involved.