Method and system for finding one or more unique entities in data

摘要

Unique key fields in structured data is a critical characteristic of data which plays significant role in data management. Profiling high volume of data for discovering all possible unique keys with high accuracy is a costly and time taking affair. A method and system for finding one or more unique entities in a data have been provided. The one or more unique entities obtained by this approach are complete and the response time is quick. The method is scalable to increasing volume of data and number of fields. The system is configured to perform the analysis process in multiple phases taking the less volume initially and increasing it gradually, thereby reducing the load on later phases as the unique results found with light volume phases. The method also comprises a time check mechanism after different stages if a user wants to do discovery for limited time.