Collaborative story-based kanji learning using an augmented tabletop system

摘要

We present a novel augmented tabletop computersystem to support collaborative storybasedlearning of Japanese kanji characters bynon-native students of the Japanese language.Our system is based on interactive use of physicaland virtual media using Augmented Realitytechnologies. To investigate the eff ectivenessof this approach, we use Heisig’s decompositionof complex kanji into simpler componentparts and support constructionist learningby allowing tangible exploration and physicalconstruction – analogous to construction of ajigsaw puzzle – of complex kanji shapes fromsimpler component shapes which are printedon physical cards. Cards can be associatedwith video content that is projected onto thecard’s location, thereby augmenting the physicalkanji component with virtual media. A collaborativepen-based handwriting interface allowsstudents to create mnemonic stories, inthe form of pictures or words, to assist in mnemonicmemorization of complex kanji as collectionsof simpler components. Experimentalevaluation of the system compared user learningbehavior between experimental card-usingconditions and a control GUI condition. Forcard-using conditions, we observed increasesin exploratory activity and pointing behavior;for the AR media condition, we observedincreased exclamatory clapping. Our systemdemonstrates that story-based kanji learning– which is typically an individual learning process– can be realized as a collaborative, constructionist,and computer-assisted languagelearning activity. is points to the possibilityof story-based kanji learning technologies beingused in future classroom scenarios.