A Big Data Framework for Mining Sensor Data Using Hadoop

摘要

The data gathered from IOTs is considered of high business value. The IOTs devices sense the natural conditions using sensor network comprised of sensor nodes. Mining of big sensor data for useful knowledge extraction is a very challenging task. Frequent itemsets is one of the most effective mining techniques that find important itemsets from big sensor data. In this paper, a MapReduce Frequent Nodesets-based Boundary POC tree (MR-FNBP) framework is proposed for mining Frequent Nodesets for big sensor data. The MapReduce framework is used to implement MR-FNBP to enhance its performance in highly distributed environments. Additionally, the proposed Boundary (FNBP) creates a Boundary as an early stage to exclude the infrequent itemsets, and this may reduce the overall memory and time usage. Moreover, a number of experiments were performed to evaluate the performance of MR-FNBP framework. The results show high scalability rate and a less time consuming process for MR-FNBP framework over different recent systems.