Research on FP-Growth algorithm for massive telecommunication network alarm data based on Spark

摘要

This paper proposes an improved FP-Growth algorithm which modifies the support count to filter high confidence and high lift telecommunication network alarm big data. And to satisfy the big data environment, this paper improves the algorithm to be a distributed algorithm based on Spark. Experiments show that the improved FP-Growth algorithm mining strong association rules either in frequent patterns or non-frequent patterns, and the improved distributed algorithm based on Spark is more efficient in computing than stand-alone and Hadoop mode.