Content-Based Image Retrieval in Augmented Reality

摘要

In this paper, we present a content-based image retrieval framework which augments the user's reality and supports the decision making process as well as awareness and understanding of the local marine environment. It comprises a real-time intelligent user interface combined with the 360° real-time environment display in the virtual reality headset. The image retrieval utilizes a unified hybrid adaptive image retrieval model. The presented system provides the user with a unique solution combining the virtual reality real-time headset, 360° view, and augmented reality to remotely monitor the surface and under-water marine environment. The objective of the proposed framework is to enhance the user interaction with the remote sensing and control applications. To our knowledge, it is the first system that combines real-time VR, 360° camera, and hybrid models in the context of image retrieval and augmented reality.