Duplicate data detection program, duplicate data detection method, and duplicate data detection apparatus

摘要

A computer program, method, and apparatus for narrowing data down to detect duplicate data in a short time. A computer functions as a syntax tree constructor for creating a syntax tree by extracting a plurality of letters existing at prescribed discrete positions from the character string of each of the data and a duplicate data detector for detecting some data as possible duplicate data if the data have reached a same leaf node of the syntax tree.