Accelerated cloud data transfers using optimized file handling and a choice of speeds across heterogeneous network paths

摘要

An system and method of adaptively transporting large data assets to meet desired transfer speed and cost, includes selecting folders containing files having the data, receiving input of the desired transfer speed and cost, selecting a destination memory device, reading a file header of the files for the selected folders to obtain header information, determining a file type and file size based on the header information, determining a large file size threshold based on the desired transfer speed and cost and previously measured transfer speed. When the file size of a file is above the large file size threshold, dividing the file into two or more file parts in accordance with the file type, transferring the one or more files, including any of the file parts, using a number of parallel transport machine instances, measuring a total speed of the transfer, and storing the measured total speed for use as the previously measured transfer speed.