Toa: A Web Based Network Flow Data Monitoring System at Scale

摘要

We present Toa, a web-based Network Flow data monitoring system (NMS). Toa consists of a collection of scripts that automatically parse network flow data, store this information in a database system, and generate interactive time line charts for network visualization analytics. The system is pseudo real time, meaning that it continuously updates the interactive charts from network flow data that is generated every five minutes. Toa also provides an interface to generate customized charts from the data stored in the database, and plugins that connect the visualization charts with the network flow data file for more in depth visualizations and analysis. The Toa web GUI presents users with the following network traffic visualization options: (1) per network label (interface, Autonomous System [AS], or network block) traffic, (2) per-port traffic for each network label, (3) network label to network label traffic, (4) customized charts from the database data, and (5) plugins for in-depth analysis of the network flow data file.