Research on Multiple Files Input Programming Method Based on MapReduce

摘要

Hadoop is a software framework that allows for the distributed processing of large data sets across clusters of computers using simple programming models. Hadoop is widely used due to its scalability, high reliability, low-cost, high efficiency and so on. Hadoop Distributed File System (HDFS) and MapReduce programming model are respectively used for storing and processing of the data. This paper firstly carries depth research and detailed introduction on HDFS and MapReduce, then proposing a programming method that can sort output according to the order input. Experimental results demonstrate that the proposed method is feasible and effective. Through such output, it will bring great convenience in data processing on the later work.