Use of temporal motion vectors for 3D reconstruction

摘要

Techniques for three-dimensional (3D) reconstruction of a dynamic scene as a set of voxels are provided. One technique includes: receiving, by a processor, image data from each of two or more spatially-separated sensors observing the scene from a corresponding two or more vantage points; fusing, by the processor, the image data into the set of voxels on a frame-by-frame basis; segmenting, by the processor, the image data into objects that constitute the scene; detecting, by the processor, which of the objects remain static from frame to frame, remaining ones of the objects being dynamic; filtering, by the processor, the set of voxels to remove those of the voxels corresponding to the static objects, to produce a dynamic subset of the voxels; and outputting, by the processor to a display device, those of the voxels corresponding to the dynamic objects (such as the dynamic subset) and not to the static objects.