Performance analysis of a scaleable design for replicating file collections in wide-area networks

摘要

Mirroring file collections in the global Internet is widely practiced with a recent study estimating the number of W W W hosts with mirrored content at 10/100 of all W W W hosts. Conventional mirroring tools, however, are not well-suited for the large-scale multiple- Site replication services envisioned by projects such as the Internet 2 Distributed Storage Infrastructure (I2-DSI) project. This paper presents a scaleable design for the automated Synchronization of large collections of files replicated across multiple hosts, as in I2-DSI, And outlines of how the design has been realized using rsync+, a modification to the Popular open-source mirroring tool, rsync.