APPARATUS AND METHOD FOR RECOGNIZING IMAGE-BASED CONTENT PRESENTED IN A STRUCTURED LAYOUT

摘要

A method for extracting information from a table includes steps as follows. Characters of a table are extracted. The characters are merged into n-gram characters. The n-gram characters are merged into words and text lines through a two-stage GNN mode. The two-stage GNN mode comprises sub steps as: spatial features, semantic features, CNN image features are extracted from a target source; a first GNN stage is processed to output graph embedding spatial features from the spatial features; and a second GNN stage is processed to output graph embedding semantic features and graph embedding CNN image features from the semantic features and the CNN image features, respectively. The text lines are merged into cells. The cells are grouped into rows, columns, and key-value pairs, obtaining row, column, and key-value relationships among the cells. Adjacency matrices are generated in response to the row, column, and key-value relationships among the cells.