An improved join-free snowflake schema for ETL and OLAP of data warehouse

摘要

The emergence of big data makes more and more enterprise change data management strategy, from simple data storage to OLAP query analysis; meanwhile, NoSQL-based data warehouse receive more increasing attention than traditional SQL-based database. By improving the JFSS model for ETL, this paper proposes the uniform distribution code (UDC), model identification code (MIC), standard dimension code (SDC), and attribute dimensional code (ADC); defines the data storage format of Rowkey Compound Code, Sec (Value); and identifies the extraction, transformation, and loading strategies of data warehouse. Several experiments are carried out to analyze single record and range record queries as typical OLAP based on Hadoop database (HBase). The results show the proposed scheme can provide lower overhead than the traditional SQL-based database while facilitating the scope and flexibility of data warehouse services.