Tests of PROOF-on-Demand with ATLAS Prodsys2 and first experience with HTTP federation

During the LHC Run-1, Grid resources in ATLAS have been managed by the PanDA and DQ2 systems. In order to meet the needs for the LHC Run-2, Prodsys2 and Rucio are used as the new ATLAS Workload and Data Management systems. The data are stored under various formats in ROOT files and end-user physicis...

Full description

Saved in:
Bibliographic Details
Published in:Journal of physics. Conference series 2015-12, Vol.664 (4), p.42019
Main Authors: Nardo, R. Di, Ganis, G., Vilucchi, E., Albicocco, P., Antonelli, M.
Format: Article
Language:English
Subjects:
Data analysis
Data management
Management systems
Performance enhancement
Physicists
Physics
Resource management
Workload
Workloads
Citations: Items that this one cites
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:During the LHC Run-1, Grid resources in ATLAS have been managed by the PanDA and DQ2 systems. In order to meet the needs for the LHC Run-2, Prodsys2 and Rucio are used as the new ATLAS Workload and Data Management systems. The data are stored under various formats in ROOT files and end-user physicists have the choice to use either the ATHENA framework or directly ROOT. Within the ROOT data analysis framework it is possible to perform analysis of huge sets of ROOT files in parallel with PROOF on clusters of computers (usually organised in analysis facilities) or multi-core machines. In addition, PROOF-on-Demand (PoD) can be used to enable PROOF on top of an existing resource management system. In this work, we present the first performance obtained enabling PROOF-based analysis at CERN and in some of the Italian ATLAS Tier-2 sites within the new ATLAS workload system. Benchmark tests of data access with the httpd protocol, using also the httpd redirector, will be shown. We also present results on the startup latency tests using the new PROOF functionality of dynamic workers addition, which improves the performance of PoD using Grid resources. These new results will be compared with the expected improvements discussed in a previous work.
ISSN:1742-6588
1742-6596
DOI:10.1088/1742-6596/664/4/042019