Analysis of parallel application checkpoint storage for system configuration

The use of fault tolerance strategies such as checkpoints is essential to maintain the availability of systems and their applications in high-performance computing environments. However, checkpoint storage can impact the performance and scalability of parallel applications that use message passing....

Full description

Saved in:
Bibliographic Details
Published in:The Journal of supercomputing 2021-05, Vol.77 (5), p.4582-4617
Main Authors: León, Betzabeth, Franco, Daniel, Rexachs, Dolores, Luque, Emilio
Format: Article
Language:English
Subjects:
Compilers
Computer Science
Fault tolerance
Interpreters
Message passing
Process mapping
Processor Architectures
Programming Languages
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:The use of fault tolerance strategies such as checkpoints is essential to maintain the availability of systems and their applications in high-performance computing environments. However, checkpoint storage can impact the performance and scalability of parallel applications that use message passing. In the present work, a study is carried out on the elements that can impact the storage of the checkpoint and how these can influence the scalability of an application with fault tolerance. A methodology has been designed based on predicting the size of the checkpoint when the number of processes, the application workload or the mapping varies, using a reduced number of resources. By following this methodology, the system administrator will be able to make decisions about what should be done with the number of processes used and the number of appropriate nodes, adjusting the process mapping in applications that use checkpoints.
ISSN:0920-8542
1573-0484
DOI:10.1007/s11227-020-03445-1