ETL APPARATUS AND METHOD FOR CONTROLLING SKEW IN DISTRIBUTED ETL JOB

摘要

An apparatus and a method for controlling a skew in a distributed extract, transform, load (ETL) job are disclosed. According to an embodiment of the present invention, the apparatus for controlling a skew in a distributed ETL job comprises: a division unit for generating a plurality of partitions distributively processed by a plurality of ETL tasks by dividing original data; and a re-division unit for identifying a straggler of the plurality of partitions based on a size of each of the plurality of partitions, and dividing the straggler based on the number of available containers.