Design and implementation of scenic-spot introduction-task-oriented3D virtual human spoken dialogue system

摘要

A scenic-spot introduction-task-oriented 3Dvirtual human spoken dialogue system—EasyGuide is introduced.The system includes five modules:natural language processing,task domain knowledge database,dialogue management,voice processing and 3Dvirtual human text-to-visual speech synthesis.In the first module,dictionary construction along with sentence analysis and semantic representation are illustrated specifically.A tree-structured knowledge database is designed for the task domain.A novel framework based on the keyword analysis and context constraints is proposed as the dialogue management.As for voice processing module,a software development kit which performs speech recognition and synthesis is introduced briefly.In the last module,3Dviseme synthesis is explained with examples and a text-driven facial animation system is presented.Evaluation results show that the system can achieve satisfactory performance.