This paper introduces a novel multimedia system for instructing or guiding works. The system observes a user by image and speech recognition, and gives related information or appropriate advices by utilizing pre-recorded video archives. The distinctive feature of our media is that the system quietly observes a user and interrupts the user only when he/she really needs a help, for example, in a situation that the user is at a standstill or asks a question. Otherwise, the system only presents related information that may be useful to the user, and it does not require any responses from the user. In this paper, a method for recognizing a user's status and a method for matching it to the contents in video archives are mainly described.
展开▼
