Multimodal Integration Using Complex Feature Set

摘要

Multimodal integration is an important problem of multimodal user interface research. After briefly surveying research on multimodal integration, this paper introduced a natural language processing method to resolve the problem of integration. It introduced the unification operation on complex feature set and extended this operation in order to represent the information from input modalities and implement multimodal integration.