Multi-thread performance on a single thread in-memory database

摘要

Industries have now leveraged commodity hardware on their big data products. When it comes to big-data, large scale tasks are executed with a huge amount of data being processed and optionally stored in persistent storage. One of leading innovation in alternative NoSQL and big data which enables low cost commodity hardware plays role is Redis, an in-memory database technology. Instead of disk, memory used in Redis is mainly to avoid latency during I/O processes. Big data processes require tons of I/O process on storage. This makes in-memory database run faster than conventional disk-optimized database. This research is an attempt to expose latency and improve performance by experimenting multi-thread approach during short message (SMS) delivery in single-thread Redis environment in combination with Rapidpro, a mass SMS management platform.