Multimodality and speech technology: Verbal and non-verbal communication in talking agents

摘要

This paper presents methods for the acquisition and modelling of verbal and non-verbal communicative signals for the use in animated talking agents. This work diverges from the traditional focus on the acoustics of speech in speech technology and will be of importance for the realization of future multimodal interfaces, some experimental examples of which are presented at the end of the paper.