High-Throughput and Low-Latency Distributed Management Proxy for Key-Value Store Over 100Gbps Ethernet on FPGA

摘要

Key-value store (KVS) is one of the most important NoSQL databases. To satisfy the demand for growing data in the era of big data, distributed KVS systems that enhance the scalability of storage systems are widely used in recent years. Hence, high-performance distributed management that implements functions such as data partitioning and message distribution is indispensable. In this paper, we present a high-throughput and low-latency distributed management proxy (DMP) for key-value store over 100Gbps Ethernet (100GbE). The proxy-based design which has flexibility and generality is fully implemented on FPGA. In the DMP, the consistent hashing algorithm is designed to partition KVS packets in pipeline. Then a hardware network offload engine is proposed to transmit network messages over 100GbE on FPGA to reduce the latency penalties caused by consistent hashing. Besides, in order to utilize the 100Gbps Ethernet bandwidth, four fully parallel and pipelined data paths are implemented in the DMP on an FPGA. The experimental results show that the peak throughput of the proposed DMP can reach 77.4 million queries per second (QPS), and the latency can achieve as low as 0.8μs for the small-size packets, which is 7.4x higher and 23x faster respectively than the software proxy implementation accelerated by Intel's DPDK.