Fine-grained processing towards HL-LHC computing in ATLAS

摘要

During LHC's Run-2 ATLAS has been developing and evaluating new fine-grained approaches to workflows and dataflows able to better utilize computing resources in terms of storage, processing and networks. The compute-limited physics of ATLAS has driven the collaboration to aggressively harvest opportunistic cycles from what are often transiently available resources, including HPCs, clouds, volunteer computing, and grid resources in transitional states. Fine-grained processing (with typically a few minutes' granularity, corresponding to one event for the present ATLAS full simulation) enables agile workflows with a light footprint on the resource such that cycles can be more fully and efficiently utilized than with conventional workflows processing O(GB) files per job. The workflow component of this approach, the ATLAS Event Service, is currently in production on some grid sites and on several supercomputing sites. The Event Service architecture allows real-time delivery of fine-grained workloads to payload applications running on compute nodes. The outputs produced by the payload applications are immediately streamed out into a secure location, such that Event Service jobs can be terminated practically at any time with minimal data losses. On HPCs the architecture gives us the flexibility to dynamically vary the size of submitted jobs from several up to thousands of concurrent nodes and the duration of jobs from less than an hour (backfill jobs) to multiple hours, thus maximizing the utilization of the machine by ensuring every processing unit remains productively occupied. The architecture is an HPC-internal, MPI-based version of the highly scalable global workload management system of ATLAS which presently manages up to 1.2 million concurrent processors around the clock. This makes it a proven scalable candidate for exascale computing, which is expected to be an important element of LHC Run-3 computing from 2021 and HL-LHC from 2026. Today the R&D attention of the