The Design of Distributed Power Big Data Analysis Framework and Its Application in Residential Electricity Analysis

摘要

With the development of digital, information and intelligent process of power system, more and more data sources appear. The traditional standalone environment has been difficult to adapt to the need of the analysis of massive data. The power industry also needs to use real-time database, distributed storage and indexing, data mining and other technologies to achieve massive data storage and data mining. In this paper, a distributed power big data platform, which integrates storage, calculation, mining and analysis functions, is constructed based on the requirement of power industry for mass heterogeneous data processing and analysis. Then, we use Apriori algorithm to analyze residential electricity data based on the big data platform. The experimental results show that the distributed computing framework can greatly improve the efficiency of data processing. At the same time, using data mining technology to analyze residential electricity data can help us find the distribution and change rules of electric load and improve load forecasting ability.