Big data analysis of campus card based on spark

摘要

In recent years, people obtain useful results by analyzing consumption data collecting from campus card adapting statistical and data mining. The aim of this study is how to using the approaches of big data analytics in consumption data from campus card to improve working efficiency which is using traditional statistical and data methods mining. The consumption data first is processed under Spark framework, including consumer queries based on Spark SQL and mining consumption data by using K-Means approach given from Spark MLlib. Experimental results show adopting spark framework can quickly and efficiently to analyze campus card consumption data.