MapReduce system productivity measurement model and measuring approach

摘要

How to effectively utilize the computing resource remains a longstanding challenge in MapReduce application, and MapReduce system productivity has become a major issue in research field. In the paper, we explored the productivity mathematical models for MapReduce system, defining the productivity as the ratio of the workload and energy consumption per unit time, and proposed the measurement approach for MapReduce system productivity. Based on the measurement model and approach, this paper selected CPU intensive and I/O intensive computing in MapReduce to measure and evaluate MapReduce system productivity. Finally the measurement and evaluation result showed that productivity model and approach in the paper is reasonable and valid for architecture design of MapReduce system in production environment.