METHOD AND APPARATUS FOR SCALABLE GRAPH MINING USING GRAPH PRE-PARTITIONING

摘要

According to an embodiment of the present invention, an apparatus for large-scale graph mining using a matrix vector product based on pre-partitioning of graphs comprises: a communication unit to collect graph data consisting of a plurality of peaks and a plurality of trunk lines becoming graph mining targets; a data partitioning method determination unit to determine a partitioning method for a graph matrix corresponding to the graph data; a data partitioning size determination unit to consider memory sizes of a plurality of operation devices to perform matrix-vector operations for the graph matrix and the number of the operation devices to determine a partitioning size for the graph matrix or a vector corresponding to the peaks; a data partitioning unit to partition the vector into vector blocks based on the partitioning method and the partitioning size, and partition the graph matrix into graph sub-matrices corresponding to the vector blocks; and a data operation distribution unit to distribute the vector bocks and the graph sub-matrices corresponding to the vector blocks to the operation devices to process matrix-vector operations.