Architecture for a data cleansing application

摘要

A system cleanses data. The system includes an input component, a pre-process component, an automated learning component, and a post-process component. The input component receives a collection of records. The pre-process component formats the collection of records and creates a plan for cleansing the collection of records. The automated learning component performs the plan and modifies the plan based on feedback from intermediate steps within the plan. The post-process evaluation component evaluates the result of the automated learning component. The post-process component determines whether to accept the result or to feed back the result to the automated learning component.