首页> 外国专利> SYSTEM AND METHOD FOR DEEP LEARNING BASED HAND GESTURE RECOGNITION IN FIRST PERSON VIEW

SYSTEM AND METHOD FOR DEEP LEARNING BASED HAND GESTURE RECOGNITION IN FIRST PERSON VIEW

机译:基于第一人称视角的基于深度学习的手势识别系统及方法

摘要

A system and method for hand-gesture recognition are provided. The methodincludesreceiving frames of a media stream of a scene captured from a first personview (FPV) of auser using at least one RGB sensor communicably coupled to a wearable ARdevice. Themedia stream includes RGB image data associated with the frames of the scene.The scenecomprises a dynamic hand gesture performed by the user. A temporal informationassociatedwith the dynamic hand gesture is estimated from the RGB image data by using adeeplearning model. The estimated temporal information is associated with handposes of theuser and comprising a plurality of key-points identified on user's hand in theplurality offrames. Based on the temporal information of the key points, the dynamic handgesture isclassified into at least one predefined gesture class by using a multi-layeredLSTMclassification network.
机译:提供了一种用于手势识别的系统和方法。方法包括接收从第一人称拍摄的场景的媒体流的帧查看(FPV)用户使用至少一个与可穿戴式AR通信连接的RGB传感器设备。的媒体流包括与场景帧关联的RGB图像数据。现场包括由用户执行的动态手势。时间信息关联的动态手势的估计是通过使用深学习模型。估计的时间信息与手相关联的姿势用户,并包括在用户手上识别的多个关键点多个框架。基于关键点的时间信息,动态指针手势是通过使用多层将其分类为至少一个预定义手势类LSTM分类网络。

著录项

相似文献

  • 专利
  • 外文文献
  • 中文文献
获取专利

客服邮箱:kefu@zhangqiaokeyan.com

京公网安备:11010802029741号 ICP备案号:京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有
  • 客服微信

  • 服务号