MAPREDUCE JOB EXECUTION SYSTEM AND MAPREDUCE JOB EXECUTION METHOD

摘要

PROBLEM TO BE SOLVED: To enable simultaneous job execution even when jobs are integrated by MapReduce and suppress reduction in the availability ratio of a server resource.;SOLUTION: In a MapReduce job execution system in which a plurality of Mappers or Reducers constituting a MapReduce job process and execute the same input data, determination is made, on the basis of a definition file of the input/output data used in the MapReduce job and the relationship of MapReduce jobs with each other, as to the presence of a second MapReduce job in which the output data of a first MapReduce job is processed as input data. When it is determined that the job is present, a first Reducer for generating output data on the basis of the same input data and a second Reducer for generating different output data on the basis of the same input data are redefined, and the order in which Reduce tasks are executed is controlled so that the first Reducer is completed before the second Reducer.;COPYRIGHT: (C)2015,JPO&INPIT