APPARATUS AND METHOD FOR EVALUATING PRONUNCIATION ACCURACY FOR FOREIGN LANGUAGE EDUCATION

摘要

The present invention relates to a device for evaluating pronunciation accuracy for education in a foreign language, and more specifically, as a device for evaluating pronunciation accuracy, an input module that receives a voice signal that a learner pronounces and an image of a learner who pronounces the voice signal; A speech analysis module for extracting a phoneme sequence from a learner's speech signal; An image analysis module that recognizes a mouth-shaped landmark from the learner's image and extracts a sequence of changes of the recognized mouth-shaped landmark; And an evaluation module for evaluating pronunciation accuracy using the phoneme sequence of the speech signal extracted from the speech analysis module and the video analysis module and the change sequence of the mouth-shaped landmark. In addition, the present invention relates to a method for evaluating pronunciation accuracy for foreign language education, and more specifically, as a method for evaluating pronunciation accuracy, (1) receiving a voice signal that a learner pronounces and an image of a learner who pronounces the voice signal. ; (2) extracting a phoneme sequence from a learner's speech signal; (3) recognizing a mouth-shaped landmark in the learner's image and extracting a sequence of changes of the recognized mouth-shaped landmark; And (4) evaluating pronunciation accuracy using the phoneme sequence of the speech signal extracted in steps (2) and (3) and the change sequence of mouth-shaped landmarks. . According to the pronunciation accuracy evaluation apparatus and method for foreign language education proposed in the present invention, the pronunciation accuracy is evaluated by evaluating the pronunciation accuracy using a phoneme sequence extracted from a learner's voice signal and given attributes such as rhythm, pitch, and accent of pronunciation. The pronunciation characteristics can be reflected and evaluated effectively, and the reliability of the evaluation results of the pronunciation accuracy can be improved by extracting the sequence of changes in the mouth-shaped landmarks from the image of the learner making the pronunciation and comparing it with the mouth shape of the native speaker. In addition, according to the apparatus and method for evaluating pronunciation accuracy for foreign language education proposed in the present invention, not only the similarity and similarity of phonetic waveforms between native speaker pronunciation and learner pronunciation, but also phoneme sequences and mouth lands with attributes By comprehensively reflecting the sequence of change of mark to evaluate the pronunciation accuracy, it is possible to provide a comprehensive evaluation result with high confidence in the pronunciation accuracy, which enables foreign language learners to accurately recognize and compensate for the problem, and to improve the pronunciation accuracy. You can improve your learning effectiveness by presenting a guide to it.