This paper demonstrates a relatively new user interface, hand position. The interface is characterized by using a common webcam to interpret hand position. This interface is demonstrated by a system which implements a virtual percussive keyboard musical instrument. To simplify the playing the virtual keyboard and also the discrimination of position from the background, the user holds a drum stick with a ball of red tape wrapped around the end similar to a child's xylophone mallet. A user can simulate playing this instrument by moving this drum stick within the view of the webcam relative to the virtual keyboard. The webcam processes a drum stick's position and maps it to a virtual keyboard. The virtual keyboard is interfaced to a MIDI device which produces any of the various sounds supported by MIDI, such as a xylophone, organ, guitar, trombone, flute, etc.
展开▼
