A knowledge-based approach for quality-aware ETL process

摘要

ETL processes (Standing for Extract, Transform and Load) are focal component in the data warehousing projects. They supply the warehouse with the necessary integrated and reconciled data. However, they are the first to blame when wrong business decisions are made, as they provide incorrect or misleading data. Therefore a correct design of this process at early stages of data warehouse (DW) project is required. This calls for a specific knowledge to design ETL process able to provide data of good quality. A way to achieve this is to provide the ETL worker (designer, monitor, developer) with the necessary knowledge. Accordingly, we propose to anticipate the most likely to happen exceptions during ETL process and then to resolve it. Consequently, we provide a set of best practices and methodologies modeled as knowledge to the benefit of the ETL worker during the process lifecycle. Finally, we instantiate a prototype as an initial validation of this approach.