Retrieval and reorganization of operation manual data based on state transition and device data acquisition by mobile terminals

摘要

In this paper, we propose a new way to retrieve, reorganize and present operation manual data of devices by mobile terminals. The proposed way is based on (1) device data acquisition by mobile terminals, (2) retrieval and reorganization of data from device state transition diagrams and device operation manual data, and (3) presentation of retrieved data in multimodal manner (3D CG animation synchronized with speech guidance). To realize the proposed method, we have implemented a prototype, in which we used Web3D, speech synthesis, and XTND technologies.