Systems and methods for determining dataset intersection

摘要

Comparison between location information in binary structures, enables determination of an indication of the intersection between datasets. A deterministic function is applied to the entries associated for a key in the first dataset location, and in the second and compared to determine an indication of the intersection between the data sets. An indication of a duplication level and the relationship between the intersection and duplication level can be made. The binary structure may be generated on the fly, and may be bloom filters of a common length.