System and method for efficient and secure private similarity detection for large private document repositories

摘要

A computer-based system and method for detecting duplicate documents that comprises generating an encoded signature for a retrieved document 305, the signature being based on a data field within the document; determining, via a smart contract on a distributed ledger, whether the retrieved document is the same as a document within a set of stored documents by comparing the signature of the retrieved document to signatures of the stored documents 307; and notifying a user when a duplicate document is found 309, 310. Each document may have an immutable data field with a value and where the values exactly match the documents are considered to be duplicates. Each signature may be a hash of the relevant document. Stale document signatures can be removed from the blockchain ledger. The retrieved document may be a medical claim document.