Recent developments in video-tracking allow the outlines of moving, natural objects in a video-camera input stream to be tracked live, at full video-rate. Previous systems have been available to do this for specially illuminated objects or for naturally illuminated but polyhedral objects. Other systems have been able to track nonpolyhedral objects in motion, in some cases from live video, but following only centroids or key-points rather than tracking whole curves. The system described here can track accurately the curved silhouettes of moving non-polyhedral objects at frame-rate, for example hands, lips, legs, vehicles, fruit, and without any special hardware beyond a desktop workstation and a video-camera and framestore.
The new algorithms are a synthesis of methods in deformable models, B-splines curve representation and control theory. This paper shows how such a facility can be used to turn parts of the body-for instance, hands and lips-into input devices. Rigid motion of a hand canbe used as a 3D mouse with non-rigid gestures signalling a button press or the "lifting" of the mouse. Both rigid and non-rigid motions of lips can be tracked independently and used as inputs, for example to animate a computer-generated face.
视频跟踪的最新发展允许以全视频速率实时跟踪视频摄像机输入流中移动的自然物体的轮廓。现有的系统已经可以用于特殊照明的物体或自然照明但多面体的物体。其他系统已经能够从实时视频中跟踪运动中的非多面体对象,但仅跟踪质心或关键点,而不是跟踪整个曲线。此处描述的系统可以以帧速率准确地跟踪移动的非多面体对象(例如手,嘴唇,腿,车辆,水果)的弯曲轮廓,并且无需台式工作站,摄像机和帧存储器以外的任何特殊硬件。 P>
新算法是可变形模型,B样条曲线表示和控制理论中方法的综合。本文展示了如何使用这种工具将身体的各个部分(例如手和嘴唇)变成输入设备。手的刚性运动可以用作3D鼠标,其非刚性手势表示按下按钮或鼠标“抬起”。嘴唇的刚性和非刚性运动都可以独立跟踪,并可以用作输入,例如为计算机生成的脸设置动画。 P>
机译:RGB2HANDS:来自单眼RGB视频的3D手交互的实时跟踪
机译:手持式3D扫描仪,用于表面形状测量,无需传感器姿态跟踪或表面标记
机译:多视图视频的非刚性3D形状跟踪
机译:用于视频序列中自动唇轮廓跟踪的多特色混合活动形状模型
机译:嘴唇追踪和快速的嘴形提取。
机译:校正:D-Track –一种半自动3D视频跟踪技术,用于分析水生动物的运动和例行程序,并将其应用于圈养海豚
机译:朝向3D身体部位检测视频数据集和手部跟踪基准
机译:使用常规视频摄像机进行人机交互的实时眼动跟踪和手部跟踪