Are real tongue movements easier to speech read than synthesized?

摘要

Speech perception studies with augmented reality displays in talking heads have shown that tongue reading abilities are weak initially, but that subjects become able to extract some infor-mation from intra-oral visualizations after a short training ses-sion. In this study, we investigate how the nature of the tongue movements influences the results, by comparing synthetic rule-based and actual, measured movements. The subjects were sig-nificantly better at perceiving sentences accompanied by real movements, indicating that the current coarticulation model de-veloped for facial movements is not optimal for the tongue.