A cloud computing based system for cyber security management

摘要

The exponential increase of cyber security has led to an ever-increasing accumulation of big network data for cyber security applications. The big data analysis for cyber security management presents challenges in data capturing, storing and processing. To address these challenges, in this paper we develop a cloud computing based system for cyber security management to fasten the analysis process of big network data. Our developed system is built on the MapReduce framework and consists of end-user devices, cloud infrastructure and a monitoring centre. To make our proposed system efficient, we introduce two key function modules of our system: data storage module and task scheduling module. We conduct the system implementation using Apache Hadoop, and our implemented system consists of data collection, data normalisation, data computation and data visualisation. Using ranking and aggregation as primitives for performing cyber security management, we conducted extensive experiments to show the effectiveness of our developed system. We also discuss how to extend our proposed system to other applications.