A performance study on different data load methods in relational databases

摘要

Alongside with new cloud system emerging, legacy systems inside organizations are being migrated. With them, databases, and all stored data, which might variate from some GB to large amounts of TB. These systems migrations pose considerable problems - data export method, import method, consumed time, consistency, and so on - the so-called legacy system migration opens a new research topic, concerning how to migrate data timely efficient. The same problem, loading data, can be applied to ETL processes, with particular focus to the Load phase, which needs to be performed as fast as possible. This paper provides a brief review of different relational databases load methods and compares their performance. Experimental results show that despite the different available methods to efficiently load data (without losing information), performance is severely affected, presenting variations that can go from seconds to hours/days depending on the used strategy.