見真似による発音練習システムのための口唇動作CGアニメーション

摘要

The pronunciation practice CAI system called "Lip Reading あい" for deaf children based on bimodality of human speech and lip reading techniques has been developed. This CAI system enables a learner to practice pronunciation by looking at the model speaker's mouth movement and allows to compare his/her own mouth movement. It simultaneously allows to compare his/her own mouth movement with the model's as both are shown on the screen of a computer by the video camera connected to it. This system provides a study unit to practice pronunciation looking at computer graphics animation of mouth movement of the model speakers. In order to evaluate the effectiveness of this CAI system by using CG animation, Japanese vowel and consonant sounds were read by a group of Japanese students. Then their mouth movement before and after practicing with the CAI system was videotaped and was evaluated. The rate of correctly perceived mouth movements was 11% greater., after practicing with the system.%人間の音声認識における双方特性化や読唇術に着目した聴覚障害児用発音練習システム“Lip Readingあい”を開発している.本システムでは，学習者が発音時にネットワークカメラから取り込んだ学習者自身の口唇動画像をパソコン画面上に表示し，モデル話者の口唇動作と比較しながら発音練習が行える.さらに，発音時に提示する口唇動作としてモデル話者の口唇動作を強調したCGアニメーションを開発し，これを見ながらの発音練習を可能にした.口唇動作CGアニメーションを用いた発音練習の学習効果を調べるため，日本人学習者が日本語母音と子音を発音する際の音声および口唇動作を学習前後にビデオ録画した，システムを用いた発音練習後，学習者における口唇動作は改善し，同定率が11%向上していた.