Ingress Flow Based Triple Token Bucket Traffic Control System for Distributed Networks

摘要

Network processors in applications like cloud-based services call for sophisticated algorithms of traffic rate control mechanisms with different flexibility levels at different sites of the network. This paper presents the design, implementation, and analysis of distributed rate limiters, which work together to enforce a global rate limit across traffic aggregates at multiple sites, enabling the coordinated policing of a cloud-based service's network traffic. The implementation enforces global limit and ensures that the congestion/responsiveness appears as though it has passed through a single shared rate limiter.