Accelerating Write Performance for Microservices Utilizing a Write-Ahead Log

摘要

Write performance is accelerated in a microservices deduplication system having a master node and a worker node, where the worker node receives and writes updates to data similarity groups to a cache and to a primary write-ahead log. Periodically, the worker writes updated similarity groups from cache to object storage, and flushes the contents of the primary write-ahead log. During flushing of the primary write-ahead log, the worker writes similarity group updates to a secondary write-ahead log which is swapped for the primary write-ahead log and which becomes a new primary write-ahead log for updates during flushing and during a subsequent time period. The previous primary write-ahead log becomes the new secondary write-ahead log, and the log swapping is repeated during subsequent time periods.