SYSTEM AND METHOD FOR GENERATING AUTOMATIC BLOCKING FILTERS FOR RECORD LINKAGE

摘要

A method for generating blocking filters for record linkage includes providing a training database and an initial filter comprising a set of blocking keys, generating a set of positive training examples from said training database using said initial blocking keys and a given scoring method, generating from said positive training examples one or more acceptable blocking filters with a high recall with respect to said training examples, estimating a reduction rate of each of said acceptable filters, and selecting those acceptable filters with the reduction rates that exceed a predetermined threshold.