Perspectives of gestures for gestural-based interaction systems: towards natural interaction

摘要

A frequently mentioned benefit of gesture-based input to computing systems is that it provides naturalness in interaction. However, it is not uncommon to find gesture sets consisting of arbitrary (hand) formations. These “gestures” are imposed with functionalities illogical of semantic interpretation, which defeat the purpose of using gestures as a means to facilitate natural interaction. The root of the issue seems to stem from a separation between what is deemed as gesture in the computing field with what is deemed as gesture theoretically. The drive behind this paper is to find whether there is a way to find a common ground that can bring these two diverse elements into agreement. Accordingly, exploration on the fundamental aspects of gestures was done. The aspects of definition and classification of gestures in the literature of human to human/environment interaction (psycholinguistic-based studies) and human to computer (HCI-based studies) are analyzed and presented in this paper. Our findings show that there exists a connection between the two perspectives, which we conclude could guide in the process of deriving more natural gesture sets for computing systems.