Assessing resilient versus stop-and-restart fault-tolerant solutions in MPI applications

The Message Passing Interface (MPI) standard is the most popular parallel programming model for distributed systems. However, it lacks fault-tolerance support and, traditionally, failures are addressed with stop-and-restart checkpointing solutions. The proposal of User Level Failure Mitigation (ULFM...

Full description

Saved in:
Bibliographic Details
Published in:The Journal of supercomputing 2017, Vol.73 (1), p.316-329
Main Authors: Losada, Nuria, Martín, María J., González, Patricia
Format: Article
Language:English
Subjects:
Checkpointing
Compilers
Computer networks
Computer Science
Fault tolerance
Interpreters
Message passing
Parallel programming
Processor Architectures
Programming Languages
Resilience
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:The Message Passing Interface (MPI) standard is the most popular parallel programming model for distributed systems. However, it lacks fault-tolerance support and, traditionally, failures are addressed with stop-and-restart checkpointing solutions. The proposal of User Level Failure Mitigation (ULFM) for the inclusion of resilience capabilities in the MPI standard provides new opportunities in this field, allowing the implementation of resilient MPI applications, i.e., applications that are able to detect and react to failures without stopping their execution. This work compares the performance of a traditional stop-and-restart checkpointing solution with its equivalent resilience proposal. Both approaches are built on top of ComPiler for Portable Checkpoiting (CPPC) an application-level checkpointing tool for MPI applications, and they allow to transparently obtain fault-tolerant MPI applications from generic MPI Single Program Multiple Data (SPMD). The evaluation is focused on the scalability of the two solutions, comparing both proposals using up to 3072 cores.
ISSN:0920-8542
1573-0484
DOI:10.1007/s11227-016-1863-z