Data migration helper using domain information

摘要

Data migration is considered as a critical task to achieve a single source of data that is standardized and contains all-important data to the business. In this work, we propose a technique to define migration schema using an ETL tool that automates several mundane activities in mapping the data items from the source database into targeted database. The schema is generated automatically using a string-matching algorithm founded by a domain-related dictionary (i.e., oil & gas). However, human analysts are still needed to correct and validate the candidate-mapping schema. Several cases have been applied to validate this approach. We have also exercised the usage of a simple ontology to reduce the manual activities in defining the mapping schema. It produced promising results, and we believe further research in this direction, using ontology will be able to reduce the manual activities significantly.