Remote data access in computational jobs on the ATLAS data grid

This work describes the technique of remote data access from computational jobs on the ATLAS data grid. In comparison to traditional data movement and stage-in approaches it is well suited for data transfers which are asynchronous with respect to the job execution. Hence, it can be used for optimiza...

Full description

Saved in:
Bibliographic Details
Published in:EPJ Web of conferences 2019-01, Vol.214, p.4028
Main Authors: Begy, Volodimir, Barisits, Martin, Lassnig, Mario, Schikuta, Erich
Format: Article
Language:English
Subjects:
Optimization
Parameter identification
Storage area networks
Citations: Items that this one cites
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:This work describes the technique of remote data access from computational jobs on the ATLAS data grid. In comparison to traditional data movement and stage-in approaches it is well suited for data transfers which are asynchronous with respect to the job execution. Hence, it can be used for optimization of data access patterns based on various policies. In this study, remote data access is realized with the HTTP and WebDAV protocols, and is investigated in the context of intra- and inter-computing site data transfers. In both cases, the typical scenarios for application of remote data access are identified. The paper also presents an analysis of parameters influencing the data goodput between heterogeneous storage element - worker node pairs on the grid.
ISSN:2100-014X
2101-6275
2100-014X
DOI:10.1051/epjconf/201921404028