SEMANTIC E-INK: KNOWLEDGE-BASED ASSISTANCE FOR MAKING MENTAL MODELS EXPLICIT

摘要

In this paper we describe a system which assists knowledge workers in making notes of their thoughts and transferring them to the computer. Our system processed handwritten notes written down with a digital pen. These notes are processed in order to recognize and understand their meaning. To realize such systems, two novel processing stages are proposed for the first time in literature. The first stage is the inclusion of knowledge bases into the Handwriting Recognition (HWR) process, where we make use of a person's mental model. The second stage is the transition from pure HWR to understanding of the handwritten notes, i.e. the system extracts knowledge in form of ontologies. For both novel approaches we performed a set of experiments on various data. With the proposed techniques, the recognition rate of the HWR system as well as the performance of the information extraction system are significantly increased.