Method for state-based modeling for multi-modalities processing and multi-modalities processing method using that

摘要

A state-based modeling method for processing multi-modality and a multi-modality processing method using the same are provided to integrally process a plurality of complex and concurrent multi-modalities on a multi-modal terminal regardless of input order, input delay, kind, and the number of multi-modalities. A state diagram including a ready, beginning, standby, finish, and failure state for a multi-modality input condition is modeled in an interaction manager(20). SCXML(State Chart XML(extensible Markup Language)) corresponding to the state diagram is mapped in the interaction manager. All control information exchanged between the interaction manager and a multi-modal terminal is processed based on event processing. Each modality is an independent object and is operated autonomously, does not perform direct communication with each other, and performs the communication with the interaction manger.