首页> 外国专利> AUGMENTED REALITY NAVIGATION SYSTEM FOR WRIST ARTHROSCOPIC SURGERY USING SKIN MARKERS AND METHOD THEREOF

AUGMENTED REALITY NAVIGATION SYSTEM FOR WRIST ARTHROSCOPIC SURGERY USING SKIN MARKERS AND METHOD THEREOF

机译:使用皮肤标记物用于腕关节镜手术的增强现实导航系统及其方法

摘要

The present invention relates to an augmented reality navigation system for wrist arthroscopic surgery using a skin marker and a method therefor. According to the present invention, in the augmented reality navigation system for wrist arthroscopy using skin markers, the subject to be measured before finger traction by using MRI or CT in a state where a plurality of skin markers are attached to the hand of the subject to be measured. A first capture unit that captures the hand bones of a first extractor that generates a three-dimensional image using the captured image and extracts positions of a plurality of skin markers from the three-dimensional image, a reference marker is attached to the plurality of skin markers A second photographing unit that captures the hand bones of the measurement object using a depth camera while pulling the measurement object's finger, and extracts the positions of a plurality of skin markers to which reference markers are attached from the depth image photographed through the depth camera a second extraction unit, an image correction unit for correcting a three-dimensional image using the positions of the plurality of skin markers extracted from the first extraction unit and the positions of the plurality of skin markers extracted from the second extraction unit, and A control unit for generating an augmented reality image by synthesizing the photographed hand image of the subject to be measured and the corrected 3D image, and displaying the augmented reality image.
机译:本发明涉及一种用于腕关节镜手术的使用皮肤标记的增强现实导航系统及其方法。根据本发明,在用于使用皮肤标记物的腕关节镜的增强现实导航系统中,在将多个皮肤标记物附着到待测量对象的手的状态下,在使用MRI或CT进行手指牵引之前,待测量对象。第一捕获单元,其捕获第一提取器的手部骨骼,该第一提取器使用所捕获的图像生成三维图像,并从三维图像中提取多个皮肤标记的位置,参考标记附着到多个皮肤标记上;第二摄影单元,其在拉动测量对象的手指的同时使用深度相机捕捉测量对象的手骨,并从通过深度相机拍摄的深度图像中提取参考标记附着到的多个皮肤标记的位置;第二提取单元,图像校正单元,用于使用从第一提取单元提取的多个皮肤标记的位置和从第二提取单元提取的多个皮肤标记的位置来校正三维图像,以及控制单元,用于通过合成待测量对象的拍摄的手部图像和校正的三维图像来生成增强现实图像,并显示增强现实图像。

著录项

相似文献

  • 专利
  • 外文文献
  • 中文文献
获取专利

客服邮箱:kefu@zhangqiaokeyan.com

京公网安备:11010802029741号 ICP备案号:京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有
  • 客服微信

  • 服务号