首页> 外文期刊>IEEE transactions on visualization and computer graphics >Real-Time 3D Eye Performance Reconstruction for RGBD Cameras
【24h】

Real-Time 3D Eye Performance Reconstruction for RGBD Cameras

机译:RGBD相机的实时3D眼睛性能重建

获取原文
获取原文并翻译 | 示例

摘要

This paper proposes a real-time method for 3D eye performance reconstruction using a single RGBD sensor. Combined with facial surface tracking, our method generates more pleasing facial performance with vivid eye motions. In our method, a novel scheme is proposed to estimate eyeball motions by minimizing the differences between a rendered eyeball and the recorded image. Our method considers and handles different appearances of human irises, lighting variations and highlights on images via the proposed eyeball model and the $L0$-based optimization. Robustness and real-time optimization are achieved through the novel 3D Taylor expansion-based linearization. Furthermore, we propose an online bidirectional regression method to handle occlusions and other tracking failures on either of the two eyes from the information of the opposite eye. Experiments demonstrate that our technique achieves robust and accurate eye performance reconstruction for different iris appearances, with various head/face/eye motions, and under different lighting conditions.
机译:本文提出了一种使用单个RGBD传感器进行3D眼睛性能重建的实时方法。结合面部表面跟踪,我们的方法可通过生动的眼部动作产生更令人愉悦的面部效果。在我们的方法中,提出了一种新颖的方案来通过最小化渲染的眼球和记录的图像之间的差异来估计眼球的运动。我们的方法通过建议的眼球模型和 $ L0 $ 为基础的优化。通过新颖的基于3D Taylor展开的线性化,实现了鲁棒性和实时优化。此外,我们提出了一种在线双向回归方法,以根据对侧眼睛的信息来处理两只眼睛中任何一只的遮挡和其他跟踪失败。实验表明,我们的技术可针对各种虹膜外观,各种头部/面部/眼睛运动以及在不同光照条件下实现强大而准确的眼睛性能重建。

著录项

相似文献

  • 外文文献
  • 中文文献
  • 专利
获取原文

客服邮箱:kefu@zhangqiaokeyan.com

京公网安备:11010802029741号 ICP备案号:京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有
  • 客服微信

  • 服务号