Image real-time augmented reality technology based on spatial color and depth consistency

摘要

Augmented reality can enhance people's perception of the environment by embedding virtual objects or other information in real-time images. In this paper, the color image is used as a reference to calculate the confidence of the original depth map, and stereo matching is performed according to the feature points. The depth map is mainly enhanced by the color, edge, and segmentation results of the color image. A deep computing system based on augmented reality is designed. The system can use a binocular camera to collect object images in real time and obtain better parallax images by correcting the calibrated image. The semi-global block matching algorithm and depth calculation are used to realize the tracking registration of virtual objects. Experiments in different environments show that the system has good real-time performance, light invariance, and depth consistency.