Loading…

BeeFlow: A Workflow Management System for In Situ Processing across HPC and Cloud Systems

In this paper, we propose BeeFlow - an in situ analysis enabled workflow management system across multiple platforms using Docker containers. BeeFlow can support both traditional workflows as well as workflows with in situ analysis. BeeFlow leverages Docker containers to provide a portable, flexible...

Full description

Saved in:
Bibliographic Details
Main Authors: Chen, Jieyang, Guan, Qiang, Zhang, Zhao, Liang, Xin, Vernon, Louis, McPherson, Allen, Lo, Li-Ta, Grubel, Patricia, Randles, Tim, Chen, Zizhong, Ahrens, James
Format: Conference Proceeding
Language:English
Subjects:
Online Access:Request full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:In this paper, we propose BeeFlow - an in situ analysis enabled workflow management system across multiple platforms using Docker containers. BeeFlow can support both traditional workflows as well as workflows with in situ analysis. BeeFlow leverages Docker containers to provide a portable, flexible, and reproducible workflow management system across HPC and cloud platforms. We showcase how current in situ visualization workflows can apply BeeFlow with DOE production codes VPIC and Flecsale.
ISSN:2575-8411
DOI:10.1109/ICDCS.2018.00103