A Proposed Framework for the Analysis of Source Data in a Data Warehouse

摘要

This paper introduces a framework for the analysis of data quality in source databases, prior to migration to the data warehouse. Additionally, as part of the framework, a tool for the collection of meta-data is proposed. The use of the framework, in conjunction with the tool, will allow the developer of a data warehouse to allocate the scarce resources available for data cleansing. This is accomplished by identifying the data fields that yield the greatest benefit to the warehouse and focusing cleansing efforts on those fields. Additionally, it is proposed that when the meta-data tool is completed, it is possible to assign the task of specific data field identification to novices on the data warehouse development team.