首页> 外文期刊>Journal of Signal and Information Processing >Real-Time Static Hand Gesture Recognition for American Sign Language (ASL) in Complex Background
【24h】

Real-Time Static Hand Gesture Recognition for American Sign Language (ASL) in Complex Background

机译:复杂背景下美国手语(ASL)的实时静态手势识别

获取原文
           

摘要

Hand gestures are powerful means of communication among humans and sign language is the most natural and expressive way of communication for dump and deaf people. In this work, real-time hand gesture system is proposed. Experimental setup of the system uses fixed position low-cost web camera with 10 mega pixel resolution mounted on the top of monitor of computer which captures snapshot using Red Green Blue [RGB] color space from fixed distance. This work is divided into four stages such as image preprocessing, region extraction, feature extraction, feature matching. First stage converts captured RGB image into binary image using gray threshold method with noise removed using median filter [medfilt2] and Guassian filter, followed by morphological operations. Second stage extracts hand region using blob and crop is applied for getting region of interest and then “Sobel” edge detection is applied on extracted region. Third stage produces feature vector as centroid and area of edge, which will be compared with feature vectors of a training dataset of gestures using Euclidian distance in the fourth stage. Least Euclidian distance gives recognition of perfect matching gesture for display of ASL alphabet, meaningful words using file handling. This paper includes experiments for 26 static hand gestures related to A-Z alphabets. Training dataset consists of 100 samples of each ASL symbol in different lightning conditions, different sizes and shapes of hand. This gesture recognition system can reliably recognize single-hand gestures in real time and can achieve a 90.19% recognition rate in complex background with a “minimum-possible constraints” approach.
机译:手势是人与人之间交流的有力手段,手势语是倾倒和聋哑人最自然,最富有表现力的交流方式。在这项工作中,提出了一种实时手势系统。系统的实验设置是使用固定位置的低成本网络摄像头,该摄像头安装在计算机显示器的顶部,分辨率为10兆像素,该摄像头使用红色,绿色,蓝色[RGB]色彩空间从固定距离捕获快照。这项工作分为四个阶段,例如图像预处理,区域提取,特征提取,特征匹配。第一阶段使用灰度阈值方法将捕获的RGB图像转换为二进制图像,并使用中值滤波器[medfilt2]和高斯滤波器去除噪声,然后进行形态学运算。第二阶段使用Blob提取手部区域,并应用作物获取感兴趣区域,然后对提取的区域应用“ Sobel”边缘检测。第三阶段将特征向量作为质心和边缘区域,将其与第四阶段中使用欧几里得距离的手势训练数据集的特征向量进行比较。最小欧几里得距离可以识别出完美匹配的手势,从而通过文件处理显示ASL字母和有意义的单词。本文包括与A-Z字母相关的26种静态手势的实验。训练数据集由每个ASL符号的100个样本组成,这些样本在不同的雷电条件,不同大小和手形下。该手势识别系统可以实时可靠地识别单手手势,并且在复杂背景下使用“最小可能限制”方法可以达到90.19%的识别率。

著录项

相似文献

  • 外文文献
  • 中文文献
  • 专利
获取原文

客服邮箱:kefu@zhangqiaokeyan.com

京公网安备:11010802029741号 ICP备案号:京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有
  • 客服微信

  • 服务号