Camera-based mobile device for converting a document based on captured images into a format optimized for display on the camera-based mobile device

摘要

A method of capturing a document with a camera-based mobile device and converting textual information of the document into a format suitable for display on the mobile device comprising the following steps performed on the mobile device: a) capturing the document with the mobile device by at least two images, adjacent images each having a common overlapping area of the document, and storing the at least two images; b) recognizing the adjacent images and compositing into a respective composite image based on the common overlapping regions of the document (stitching); c) detecting a respective layout structure having at least one text block in the respective composite image; d) recognizing letter text in the respective text block by applying an Optical Character Recognition Algorithm (OCR) and storing the respective letter text to the respective text block; e) determining and storing an order of the respective text blocks in the document taking into account the respective layout structure; f) determining a width of a display of the mobile device by automatically retrieving corresponding parameters from the mobile device and determining the format for the display of the letter texts, which is adapted to the width of the display in order to scroll only vertically when reading the letter texts on the display; g) generating a file (40) in the format with the respective letter texts in the particular order of the respective text blocks; h) providing the file (40) for the mobile device for display on the display.