Design and Implementation of Network Monitoring System Based on Data Stream Processing Technology

摘要

With the development of network technology, network speed has been improved by leaps and bounds and network traffic per unit time has been increased significantly. Most of the traditional networks monitoring tools are based on intercepting and storing all network packets, unable to adapt to some processing requirements, such as data storage, realtime analysis and security event detection in highspeed network environment. This paper designs a network monitoring system based on data stream processing techniques, which supports both real-time analysis and historical analysis, detects a variety of network security incidents effectively, reduces storage space significantly, and provides GIS-based representation of regional network status. The prototype system achieves a strong real-time and stable performance in high-speed network environment