OLAP parallel query processing in clouds with C-ParGRES

摘要

The advent of big data technologies has changed the way many companies manage their data. Several companies moved their data to the cloud using the concept of database-as-a-service (DBaaS). Moving databases to the cloud presents several challenges related to flexible and scalable management of data. Although some of these companies migrated to NoSQL databases, most still rely on relational databases in the cloud to manage data, especially data that is critical to the decision making process. Online analytical processing (OLAP) queries take a long time to be processed, thus demanding high-performance capabilities from their associated database systems to get results in a feasible time. In this article, we propose a middleware solution that can be deployed in any cloud provider, named C-ParGRES, which explores database replication and interquery and intraquery parallelism to efficiently support OLAP queries in the cloud. C-ParGRES is an extension of ParGRES, an open-source database cluster middleware for high-performance OLAP query processing in clusters. C-ParGRES exploits cloud capabilities such as on-demand resource provisioning and elasticity. In addition, C-ParGRES can create multiple and independent virtual clusters for different database and users. We evaluate C-ParGRES with two real-world OLAP applications, both from the Brazilian Institute of Geography and Statistics. Results show that C-ParGRES is a cost-effective solution for OLAP query processing in the cloud.