Transparent Transaction Processing with A High-Performance Proxy for Distributed KVS

摘要

Distributed consensus protocols require a large amount of communications for transaction processing in distributed KVS (D-KVS). Google Spanner and Amazon DynamoDB alleviate the communication overhead using highly accurate timestamping obtained from atomic clocks. However, introducing special hardware devices complicates operation management and drastic system changes. In this paper, we propose a transparent transaction processing method without depending on distributed consensus protocols and special hardware devices. We provide transaction processing functions that complies with ACID by performing exclusive control and transaction processing on a centralized high-performance proxy. The proxy provides ACID-compliant transaction processing functions to D-KVS by managing locks and transactions on multiple threads and guarantees the performance in medium-scale D-KVS (dozens of nodes). In the evaluation, first, we evaluate the overhead of the proxy with transaction processing functions, the throughput decreased by 0.2% to 12%. Next, we confirmed that the proxy processes the lightweight transaction of Cassandra with about 60% execution time. Finally, we confirmed that the proxy can process trans-actions, compared the transaction processing performance with MariaDB, it operated faster than MariaDB.