High-speed wide area, data intensive computing: A Ten Year Retrospective

摘要

Modern scientific computing involves organizing, moving, visualizing, and211u001eanalyzing massive amounts of data from around the world, as well as employing 211u001elarge-scale computation. The distributed systems that solve large-scale problems 211u001ewill always involve aggregating and scheduling many resources. Data must be 211u001elocated and staged, cache and network capacity must be available at the same time 211u001eas computing capacity, etc. Every aspect of such a system is dynamic: locating 211u001eand scheduling resources, adapting running application systems to availability 211u001eand congestion in the middleware and infrastructure, responding to human 211u001einteraction, etc. The technologies, the middleware services, and the 211u001earchitectures that are used to build useful high-speed, wide area distributed 211u001esystems, constitute the field of data intensive computing. This paper explores 211u001esome of the history and future directions of that field.