Brief Announcement: TeraByte TokuSampleSort Sorts 1TB in 197s

摘要

The tx2500 disk cluster at MIT Lincoln Labortory sorted a terabyte (10~(10) 100-byte records) in 197s using an "Indy" sort, and in 297s using a "Daytona" sort. The sort employed a parallel sample sort, and ran on 400 nodes, each containing a 6-disk RAID, and 8GB of memory, all connected by In-finiband. It employed TCP sockets to communicate between the nodes.