...
首页> 外文期刊>Journal of Theoretical and Applied Information Technology >A STUDY ON DYNAMIC HAND GESTURE RECOGNITION FOR FINGER DISABILITY USING MULTI-LAYER NEURAL NETWORK
【24h】

A STUDY ON DYNAMIC HAND GESTURE RECOGNITION FOR FINGER DISABILITY USING MULTI-LAYER NEURAL NETWORK

机译:基于多层神经网络的手指残疾动态手势识别研究

获取原文
           

摘要

Interaction between human and computer is generally performed with a keyboard and mouse. However, these interactions have certain drawbacks which cannot be done by users with physical disabilities or user who have disability from the wrist to the fingertip. To overcome this problem, an approach to recognize human hand gesture as a means of human-computer interaction is needed. The method proposed by the author is the use of algorithms: nearest neighbor, grayscaling, frame-differencing, Principal Component Analysis (PCA) and Multi-Layer Perceptron (MLP). This research was conducted in two experiments, which were experiment with six different types of hand gestures and experiments with four different types of hand gestures. Each experiment was performed five times with different value of number of hidden layers parameter and hidden neurons parameter. The best testing result obtained from the experiment with six types of hand gestures is from the second experiment with two hidden layers using 300 and 50 hidden neurons for each layer, resulting in an accuracy rate of 77.02%. The best testing result obtained from the experiment with four different types of hand gestures is from the first experiment with two hidden layers using 300 and 50 hidden neurons for each layer, resulting in an accuracy rate of 89.72%. The best overall result is then implemented into the front-end system for controlling application such as: file explorer, music player, video player, slideshows and PDF reader.
机译:人与计算机之间的交互通常使用键盘和鼠标执行。但是,这些交互具有某些缺陷,肢体残疾的用户或从手腕到指尖有残疾的用户无法做到。为了克服这个问题,需要一种将人的手势识别为人机交互手段的方法。作者提出的方法是使用算法:最近邻算法,灰度,帧差分,主成分分析(PCA)和多层感知器(MLP)。这项研究是在两个实验中进行的,分别是使用六种不同类型的手势进行的实验和使用四种不同类型的手势进行的实验。每个实验以不同的隐层数参数和隐神经元参数值执行五次。从使用六种手势进行的实验中获得的最佳测试结果来自第二个实验,该实验在两个隐藏层中使用,每个层分别使用300和50个隐藏神经元,因此准确率达到77.02%。从四种不同类型的手势进行的实验中获得的最佳测试结果是从第一个实验中获得的两个隐藏层,每个层使用300和50个隐藏神经元,每层的准确率达89.72%。然后,将最佳的总体结果实现到用于控制应用程序的前端系统中,这些应用程序包括:文件浏览器,音乐播放器,视频播放器,幻灯片和PDF阅读器。

著录项

相似文献

  • 外文文献
  • 中文文献
  • 专利
获取原文

客服邮箱:kefu@zhangqiaokeyan.com

京公网安备:11010802029741号 ICP备案号:京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有
  • 客服微信

  • 服务号