Selection of Appliance Using Skeletal Tracking of Hand to Hand-tip for a Gesture Controlled Home Automation

摘要

This study aims to utilize the hand and hand tip points detected by the Kinect for Microsoft Xbox One used for a gesture controlled home automation. Also, the appliance positional points are generated in order to form a relation between the hand point and the appliance to be selected. By gathering these points, a vector is formed between the hand point and the appliance positional point, creating the appliance vector. Also, a vector is formed from the hand to the hand tip point, creating the pointing vector. This allows the users to aim at the appliance with their hand tip. The proponents used angle comparison with a set angle threshold between the two vectors formed in order to determine if an appliance is being selected. A user must raise the left hand and open the palm to turn an appliance on, and palms closed to turn an appliance off. With this, the proponents have utilized the hand and hand tip points for selecting a user's desired appliance.