Method and apparatus for configuring relevant parameters of MapReduce applications

摘要

Method and apparatus for configuring relevant parameters of MapReduce applications. The method includes: receiving a request for processing a first MapReduce job; obtaining job feature attributes of historical MapReduce jobs; searching out a job feature attribute of a second MapReduce job associated with the first MapReduce job from within the job feature attributes of the historical MapReduce jobs; configuring relevant parameters of the first MapReduce job based on the job feature attribute of the second MapReduce job. According to this method of configuring parameters, network overheads of file transfer can be effectively reduced, the method of configuring parameters of the MapReduce job can be processed locally as much as possible, thereby effectively increasing system resource utilization while reducing the administrator's configuration burden. An apparatus for configuring relevant parameters of MapReduce application is also provided.