System, method, and apparatus for dynamically replicating data for heterogeneous Hadoop

摘要

A system for dynamically replicating data for a heterogeneous Hadoop is provided. The system includes a name node having a replication manager. The replication manager calculates a probability that a map task is allocated to a map task slot of a data node that stores an input data block of the map task out of a plurality of map task slots of data nodes by using a number of the map task slots in the Hadoop clusters comprised of heterogeneous clusters, and dynamically replicates data based on the probability.