Public Review for Towards Scalable Internet Traffic Measurement and Analysis with Hadoop

摘要

Network trace analysis is like bread and butter for the ACM SIGCOMM community. I relied on network traces for my Ph.D. thesis, which was not too long ago of course. I and my colleagues relied on a carefully constructed SAN, with a hand-tuned filesystem, and custom libraries for efficient processing. In contrast, for our bulk processing needs today, such as for online web services, we rely on clusters of several hundred commodity machines with a commodity network and distributed filesystem.