Research of Duplicate Record Cleaning Technology Based on a Reformative Keywords Matching Algorithm

摘要

Based on the analysis of the insufficiencies of the present Chinese matching algorithms, by examining the characteristics of approximately duplicate records, this paper proposes a method of duplicate record cleaning based on a reformative keywords matching algorithm. Experiments show that this method improves Recall and Precision of duplicate record evidently.