Human Computer Interaction using Virtual User Computer Interaction System

摘要

This paper proposes a real-time hand gesture recognition interface called VUCIS (Virtual User Computer Interaction System) to operate a mouse, keyboard and stylus. OpenCV and MediaPipe Hands are used to achieve this. OpenCV is utilized for its powerful image processing capabilities and computer vision. MediaPipe Hands library is used to generate 21 landmarks on a hand. By using a combination of various landmarks, a distinct gesture is assigned to a task performed by the input devices. The proposed interface allows users to interact with computers easily, reduces the need for keyboard and mouse as external hardware in certain circumstances and eliminates any form of contact with a surface, minimizing the spread of COVID-19.