An Optimized Strategy for Speculative Execution in a Heterogeneous Environment

摘要

MapReduce is a popular programming model for the purposes of processing large data sets. Speculative execution known as an approach for dealing with the above problems works by backing up those tasks running on a low performance machine to a higher one. In this paper, we have modified some pitfalls and taken computer hardware into consideration (HWC-Speculation). We also have implemented it in Hadoop-2.6 and experiment results show that our method can assign tasks evenly, improve the performance of MRV2 and decrease the execution time.