Note-Taking for 3D Curricular Contents using Markerless Augmented Reality

摘要

With the advance of pedagogical materials from printed textbooks to e-textbooks, the methods of note-taking should also be improved. For e-Learning with 3D interactive curricular contents, an ideal note-taking approach should be intuitive and tightly coupled with the curricular contents. Particularly, augmented reality (AR) technology is capable of displaying virtual contents in real-life images. Combining head-mounted displays with cameras and wearable computers, AR provides chances and challenges to improve note-taking for situated learning in contextual surroundings. We propose an AR-based note-taking system tailored for 3D curricular contents. A learner can take notes on a physical tabletop by finger writing, manipulate curricular contents using hand gestures and embed the complete notes in the corresponding contents in a 3D space. An analytic hierarchy process demonstrates the strengths and weaknesses of the proposed 3D note-taking system. Especially, note-taking using finger writing and hand gestures with 3D maneuver is better than other alternatives in terms of relevance, usefulness, intuition and novelty. RESEARCH HIGHLIGHTS 1. Developed an AR-based note-taking system tailored for 3D curricular contents such as object movies and panoramas. 2. Integrated audio and visual features so a learner can take notes on a physical tabletop using finger writing. 3. Manipulated the note in 3D to make it tightly coupled with its related 3D curricular contents. 4. Performed an AHP to evaluate the weaknesses and strengths of the proposed note-taking system. 5. Demonstrated the proposed finger writing with 3D maneuver is better than other alternatives in terms of quality and attraction.