This paper has put forward a concept of mouth-shape basic unit,and described an approcah of obtaining basic units by mouth-shape images classifying and clustering.The basic units are the gist of breakaway different states during continuous speech recognition or sequence impages speechreading,which can definitely measure off statuses for mouth shape changing in sequence images.The metbod based on mouth-shape basicu unit,compared with the approach based on feature vector dirctly,can rather reduce the number of state space branch,shrink searching space and expedite convergence rate.This paper introduces the preprocessing of mouth shape classification,the approach of real-time lip movement detection and classification,and gives experiment results of how to select the number of original clusterilg center in order to fit mouth shape classification and how to select features to be propitious to mouth shape classification,then gets a conclusion.
展开▼
