DUPLICATE DATA DETECTION PROGRAM, DUPLICATE DATA DETECTION METHOD, AND DUPLICATE DATA DETECTOR

摘要

PPROBLEM TO BE SOLVED: To provide a duplicate data detection program, a duplicate data detection method and a duplicate data detector, faciliting data refinement for detecting duplicate data in a short time. PSOLUTION: A computer 1 has the following functions. A syntactic tree construction means 2 constructs a syntactic tree for each of data with a plurality of characters at predetermined non-adjacent positions of a character string. A duplicate data detection means 2 determines, for each leaf node of the syntactic tree, whether two or more data reaching the leaf node are present or not, and detects data which reach the same leaf node as duplicate data candidates. PCOPYRIGHT: (C)2008,JPO&INPIT