A Color Sensing AR-Based Interactive Learning System for Kids

摘要

In the last decade, there has been a rapid growth in applying Augmented Reality (AR) and Internet of Things (IoT) as emerging technologies in linking physical and virtual objects for educational purposes. Realizing the complex concepts in a way that learner be able to interact with, will not only elevate the learning passion, but also has a significant positive role on learning performance and student's engagement. According to the aforementioned points, in this paper, we propose a color sensing AR-Based interactive learning system for kids which helps them to scan and explore the colors and learn their corresponding words in Spanish language. Our aim is to explore the role of such an AR-IoT-based system on students' learning performance. To do this, an embedded system including a color sensor and a raspberry pi board was implemented and provided for the kids. By placing the sensor on the specially designed colored book, the light's color frequency is measured and RGB code is sent over the cloud using MQTT protocol. On the web application side, color data is fetched from the cloud server and learners will be provided with a real-time feedback with the corresponding animations and multimedia content that teaches colors in Spanish language. Students' learning performance was assessed using paired t-test based upon the results of their pre-test and post-test, before and after interacting with the system. The successful experimental results were achieved proving the effectiveness of the system on learning performance.