High-Throughput Data Processing at FRIB Using ESnet

Real-time or nearly real-time (nearline) data processing methods are critical tools as detector technologies and data acquisition systems allow for higher data rates and volumes. The introduction of the Energy Sciences Network (ESnet), a U.S. Department of Energy (DOE) supported high-speed network f...

Full description

Saved in:
Bibliographic Details
Published in:IEEE transactions on nuclear science 2024-10, p.1-1
Main Authors: Chester, Aaron, Cerizza, Giordano, Crawford, Heather L., Fox, Ron, Liddick, Sean N., Lubna, Rebeka S., Reece, Paul, Rockwell, Tom, Vasquez, Jerry
Format: Article
Language:English
Subjects:
Codes
Data acquisition
Data processing
Detectors
ESnet
Fitting
Globus
Isotopes
Parallel processing
Particle beams
Pipelines
Software
Superfacility workflows
Throughput
Workflow automation
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Real-time or nearly real-time (nearline) data processing methods are critical tools as detector technologies and data acquisition systems allow for higher data rates and volumes. The introduction of the Energy Sciences Network (ESnet), a U.S. Department of Energy (DOE) supported high-speed network for scientific research, creates opportunities to leverage the computing power of DOE facilities like the National Energy Research Scientific Computing Center (NERSC). As a first step towards realizing a DOE Office of Science Integrated Research Infrastructure (IRI) pattern, an automated workflow was developed to remotely process data obtained from a nuclear physics experiment at the Facility for Rare Isotope Beams (FRIB) at NERSC with data transferred between FRIB and NERSC over ESnet. The workflow demonstrated the ability to process one week's worth of experimental data in approximately 90 minutes and was used successfully for nearline analysis during a recently completed FRIB experiment. A summary of the workflow development and results of recent demonstrations will be presented.
ISSN:0018-9499
1558-1578
DOI:10.1109/TNS.2024.3483555