Experience of a low-maintenance distributed data management system

In this paper we report on the setup, deployment and operation of a low-maintenance, policy-driven distributed data management system for scientific data based on the integrated Rule Oriented Data System (iRODS). The system is located at KEK, Tsukuba, Japan with a satellite system at QMUL, London, U...

Full description

Saved in:
Bibliographic Details
Published in:Journal of physics. Conference series 2014-01, Vol.513 (3), p.32095-7
Main Authors: Takase, Wataru, Matsumoto, Yoshimi, Hasan, Adil, Lodovico, Francesca Di, Watase, Yoshiyuki, Sasaki, Takashi
Format: Article
Language:English
Subjects:
Backups
Consumption
Data management
Data systems
Maintenance
Management
Physics
Running
Satellites
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:In this paper we report on the setup, deployment and operation of a low-maintenance, policy-driven distributed data management system for scientific data based on the integrated Rule Oriented Data System (iRODS). The system is located at KEK, Tsukuba, Japan with a satellite system at QMUL, London, UK. The system has been running stably in production for more than two years with minimal management overhead. The management tool that was developed to support the production system is also described. In addition we describe a simple XOR-based approach to file backup that reduces the amount of storage space consumed. In situations of large data volumes this approach can be of great benefit.
ISSN:1742-6588
1742-6596
DOI:10.1088/1742-6596/513/3/032095