Collection and harmonization of system logs and prototypal Analytics services with the Elastic (ELK) suite at the INFN-CNAF computing centre

The distributed Grid infrastructure for High Energy Physics experiments at the Large Hadron Collider (LHC) in Geneva comprises a set of computing centres, spread all over the world, as part of the Worldwide LHC Computing Grid (WLCG). In Italy, the Tier-1 functionalities are served by the INFN-CNAF d...

Full description

Saved in:
Bibliographic Details
Published in:arXiv.org 2021-05
Main Authors: Diotalevi, Tommaso, Falabella, Antonio, Martelli, Barbara, Michelotto, Diego, Morganti, Lucia, Bonacorsi, Daniele, Giommi, Luca, Simone Rossi Tisbeni
Format: Article
Language:English
Subjects:
Computation
Data centers
Large Hadron Collider
Machine learning
Predictive maintenance
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:The distributed Grid infrastructure for High Energy Physics experiments at the Large Hadron Collider (LHC) in Geneva comprises a set of computing centres, spread all over the world, as part of the Worldwide LHC Computing Grid (WLCG). In Italy, the Tier-1 functionalities are served by the INFN-CNAF data center, which provides also computing and storage resources to more than twenty non-LHC experiments. For this reason, a high amount of logs are collected each day from various sources, which are highly heterogeneous and difficult to harmonize. In this contribution, a working implementation of a system that collects, parses and displays the log information from CNAF data sources and the investigation of a Machine Learning based predictive maintenance system, is presented.
ISSN:2331-8422
DOI:10.48550/arxiv.2106.02612