A study on improvement of internet traffic measurement and analysis using Hadoop system

摘要

By using conventional database management tools, data explosion is one of the most regular triggers for the development of Big Data. This results in increase difficulty for database management and larger datasets from existing applications. The organizations face the challenge to capture, manage and analyze the data in an acceptable period of time due to the increasing size of data sets, ranging from several terabytes to multiple petabytes. The proposed research aims at resolving the problem faced in internet traffic measurement and depth analysis. As there is a wide growth in the internet traffic and high speed access, the system is facing a scalability problem. To overcome this, we are introducing a Hadoop based traffic monitoring system which performs analysis of multi-terabytes (IP, HTTP, TCP, NetFlow) of the internet traffic system in a scalable manner and for in-depth analysis of the problem, the paper shows the different features.