Analysis on data deduplication techniques of storage of big data in cloud

摘要

As nowadays, many devices are connected to the internet (Thing continuum), and many businesses deal with a huge amount of data, digital data growth is exponentially increased. Cloud computing is the optimal technology that provides many computing resources, especially storage for Big data. Cloud offers the best storage management to back up the big data from IoT, business, enterprise, or government. All data owners want the protection of their own data, so they encrypt the data before outsourcing data in clouds. As many users avail cloud storage, different users may outsource the same data with different encryption techniques, and it results in data duplication or data redundancy. Although cloud computing offers a huge amount of storage space, data duplication decreases the efficiency and performance of cloud storage, and also it results in poor data management and the requirement of high bandwidth. The deduplication technique is used to manage data duplication in clouds. Although there are some deduplication approaches used to avoid data redundancy, still they have lack efficiency. The main aim of this paper is to obtain sufficient knowledge and a good idea about deduplication techniques by surveying existing approaches and this work may help the researcher and practitioner for their future research in developing efficient cloud storage management techniques.