Construction and Application of Big Data Analysis Platform for Ideological and Political Education in Colleges

摘要

To meet the large data analysis needs of ideological and political education in colleges, this paper designs an assistant expert analysis system based on Hadoop. It integrates the functions of data acquisition, data storage, data analysis and data visualization, and provides a friendly human-computer interaction interface to shield the details of large data analysis algorithm, to help teaching staff use large data analysis technology simply and efficiently for high concurrency and rapid query. We classify and design the basic operation model based on MapReduce for users to configure complex data processing logic freely. The system can also add reusable and extensible computing and analysis module to the platform according to the field experience, to expand the data analysis and processing capabilities of the system, which facilitates users to explore iterative and incremental data.