Integrating PROOF Analysis in Cloud and Batch Clusters

High Energy Physics (HEP) analysis are becoming more complex and demanding due to the large amount of data collected by the current experiments. The Parallel ROOT Facility (PROOF) provides researchers with an interactive tool to speed up the analysis of huge volumes of data by exploiting parallel pr...

Full description

Saved in:
Bibliographic Details
Published in:Journal of physics. Conference series 2012-01, Vol.396 (3), p.32091-6, Article 032091
Main Authors: Rodríguez-Marrero, Ana Y, González Caballero, Isidro, Cuesta Noriega, Alberto, Fernández-del-Castillo, Enol, López García, Álvaro, Marco de Lucas, Jesús, Matorras Weinig, Francisco
Format: Article
Language:English
Subjects:
Cloud computing
Clusters
Computation
Computer programs
Configurations
Dynamical systems
Dynamics
Interactive
Microprocessors
Parallel processing
Physics
Proving
Software
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:High Energy Physics (HEP) analysis are becoming more complex and demanding due to the large amount of data collected by the current experiments. The Parallel ROOT Facility (PROOF) provides researchers with an interactive tool to speed up the analysis of huge volumes of data by exploiting parallel processing on both multicore machines and computing clusters. The typical PROOF deployment scenario is a permanent set of cores configured to run the PROOF daemons. However, this approach is incapable of adapting to the dynamic nature of interactive usage. Several initiatives seek to improve the use of computing resources by integrating PROOF with a batch system, such as Proof on Demand (PoD) or PROOF Cluster. These solutions are currently in production at Universidad de Oviedo and IFCA and are positively evaluated by users. Although they are able to adapt to the computing needs of users, they must comply with the specific configuration, OS and software installed at the batch nodes. Furthermore, they share the machines with other workloads, which may cause disruptions in the interactive service for users. These limitations make PROOF a typical use-case for cloud computing. In this work we take profit from Cloud Infrastructure at IFCA in order to provide a dynamic PROOF environment where users can control the software configuration of the machines. The Proof Analysis Framework (PAF) facilitates the development of new analysis and offers a transparent access to PROOF resources. Several performance measurements are presented for the different scenarios (PoD, SGE and Cloud), showing a speed improvement closely correlated with the number of cores used.
ISSN:1742-6596
1742-6588
1742-6596
DOI:10.1088/1742-6596/396/3/032091