Design and development of IoT-based latency-optimized augmented reality framework in home automation and telemetry for smart lifestyle

摘要

Internet of things (IoT) is the game changer by providing connectivity among smart devices equipped with sensors and actuators to make connected intelligence a reality. Modern technology like augmented reality (AR) is pioneering human-machine interaction by providing a better user interface/experience (UI/UX) for various IoT applications. In this paper, we have proposed AR framework for home automation and telemetry application with IoT. A complete system prototype has been designed and developed to provide end user a new AR UX in smart home with Unity™ AR android app. The system would be able to recognize the interactive object, like light, fan, and air-conditioner, and give their controls live on a 3D framework. Target object is trained in advance to recognize the type of home appliance to provide an AR control panel with preconfigured options of device control and sensor data visualization. The real-time user input from AR console is sent to a cloud server deployed on a NodeMCU. The NodeMCU connected to these home appliances to fetch sensor data for telemetry application and control signals for home automation scenario. Proposed system is completely scalable and hence can be customizable and trained for various home appliances. System is designed to minimize the latency from object detection to device control. Latency analysis shows average latency 5 s (control) and 9 s for round-trip-time (RTT) sensor data telemetry.