A multi-tiered data structure and process management system based on ROOT and CouchDB

A multi-tiered data structure, analysis toolkit and data processing management system has been constructed using ROOT and CouchDB. This system is well suited for experiments that acquire many computer files of raw data over the course of months or years, that are distributed to different computing c...

Full description

Saved in:
Bibliographic Details
Published in:Nuclear instruments & methods in physics research. Section A, Accelerators, spectrometers, detectors and associated equipment Accelerators, spectrometers, detectors and associated equipment, 2012-08, Vol.684, p.63-72
Main Authors: Cox, G.A., Armengaud, E., Augier, C., Benoît, A., Bergé, L., Bergmann, T., Blümer, J., Bres, G., Broniatowski, A., Brudanin, V., Censier, B., Chapellier, M., Chardin, G., Charlieux, F., Collin, S., Coulter, P., Crauste, O., De Jésus, M., Domange, J., Dumoulin, L., Eitel, K., Filosofov, D., Fourches, N., Gascon, J., Gerbier, G., Gironnet, J., Gros, M., Henry, S., Hervé, S., Jokisch, S., Juillard, A., Kleifges, M., Kluck, H., Kozlov, V., Kraus, H., Kudryavtsev, V.A., Loaiza, P., Marnieros, S., Menshikov, A., Navick, X.-F., Nones, C., Olivieri, E., Pari, P., Pattavina, L., Paul, B., Robinson, M., Rodenas, H., Rozov, S., Sanglard, V., Schmidt, B., Semikh, S., Tcherniakhovski, D., Torrento-Coello, A.S., Unrau, M., Vagneron, L., Verdier, M.-A., Walker, R.J., Weber, M., Yakushev, E., Zhang, X.
Format: Article
Language:English
Subjects:
CouchDB
Dark Matter
Data management
Data processing
Data structure
Data structures
Detectors
Digitization
Instrumentation and Detectors
Materials handling
Multi-tier
Physics
ROOT
Roots
Searching
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:A multi-tiered data structure, analysis toolkit and data processing management system has been constructed using ROOT and CouchDB. This system is well suited for experiments that acquire many computer files of raw data over the course of months or years, that are distributed to different computing centers and further reduced in size by several steps of data processing. Data handling for experiments searching for rare events extracted from digitized pulse traces typically fit this description. An implementation of this system has been constructed for the EDELWEISS-III experiment and is described here in some detail. This solution may also serve as a prototype system for the proposed EURECA experiment.
ISSN:0168-9002
1872-9576
DOI:10.1016/j.nima.2012.04.049