GESTURE-LEVEL GRAMMAR ARRANGEMENTS FOR SPATIAL-GESTURE USER INTERFACES SUCH AS TOUCHSCREEN, HIGH-DIMENSIONAL TOUCH PAD (HDTP), FREE-SPACE CAMERA, AND OTHER USER INTERFACE TECHNOLOGIES

摘要

A system for a spatial-gesture user interface employing grammatical rules at gesture levels. Real-time spatial-gesture information measured by a spatial-gesture user interface is processed to at least a recognized sequence of specific gestures and that the sequence of gestures that the user's execution of a gesture sequence has been completed. Many additional features are then provided from this foundation, including gesture grammars, structured-meaning gesture-lexicon, imposed interpretations, context, and gesture-rendering prosody. The invention can be used to provide very general spatial-gesture grammar user interface for touchscreens, high dimensional touch pad (HDTP), free-space camera, and other user interfaces. In an implementation, each individual gesture rendered by the user can be recognized according to the sequence of recognized gestemes derived from information measured by a spatial-gesture user interface. In an implementation, various distinct subsets of gestemes can be concatenated in space and time to construct a sequence of individual gestures.