MODULAR PRODUCTION OF RICH DIGITAL TALKING BOOKS

摘要

This paper presents a framework for automatic production of rich Digital Talking Books (DTB). The production process converts existing audio tapes and OCR-based digitalization of text books into full-fledged, multiple synchronized, multimodal digital books. The framework deals with the content organization processes and User Interface definition. The first one identifies content units and its relations. The latter, based on abstract, yet DTB specific, pattern-based UI specifications, allows the definition of various forms of interaction and presentation, required by the diversity and constraints of targets users (e.g. visually impaired persons) and situations of use (e.g. learning). The framework also permits to balance the complexity and flexibility of the generated DTBs, in order to cope with the resources provided on the different execution platform.