Method of extracting text information such as abbreviation handwriting atypical word and sentence included in a predetermined image and automatically translating the extraction result into a predetermined language

摘要

The present invention relates to a method for automatically extracting text information such as abbreviations, handwriting, unstructured words, and sentences included in a predetermined image and automatically translating the extracted result into a predetermined language, and using the various data sets, the text information included in the image A new method to automatically translate to a specific language after extracting The first embodiment of a method of automatically extracting text information such as abbreviations, handwriting, atypical words, and sentences included in a predetermined image, which is the technical idea of the present invention, and automatically translating the extracted result into a predetermined language Transmitting an image captured by the camera of the terminal or an image stored in the terminal to the server; Scanning the image from the server; Converting the scanned image into an image of a predetermined resolution set by the server; Extracting color information for each pixel constituting the image; Collecting blob information which is one or more shape information composed of the same color; Detecting text line information of the blob information and determining a first language (Korean, English, Chinese, etc.) corresponding to the blob information; Normalizing the size and height of the blob information; Extracting text information corresponding to the blob information; Selecting a word having the highest similarity to the text information from words in a first language (Korean if it is determined to be Korean in the above) stored in a language database (eg, the second data set described in the detailed description); Translating the selected word into a second language (eg, English) different from the first language (one phrase); And transmitting the second language to the terminal. When extracting text information such as abbreviations, handwriting, unstructured words, and sentences included in a predetermined image proposed by the present invention and then performing an automatic translation of the extracted results into a predetermined language, the following effects can be expected. In the present invention, when a part in which a predetermined language is displayed through a terminal in everyday life is photographed and transmitted to a server, the server automatically translates the language in a language set by the user and provides it to the terminal. Therefore, if you take pictures of menus, signs, etc. while traveling abroad using a terminal equipped with the app proposed in the present invention, there will be an advantage that it can be provided in translation in real time in the native language. In addition, when the TTS function is provided, any foreign language may be translated into a native language desired by the user and then simply listened through the speaker of the user terminal.