KaMPIng: Flexible and (Near) Zero-Overhead C++ Bindings for MPI

The Message-Passing Interface (MPI) and C++ form the backbone of high-performance computing, but MPI only provides C and Fortran bindings. While this offers great language interoperability, high-level programming languages like C++ make software development quicker and less error-prone. We propose n...

Full description

Saved in:
Bibliographic Details
Published in:arXiv.org 2024-11
Main Authors: Tim Niklas Uhl, Schimek, Matthias, Hübner, Lukas, Hespe, Demian, Kurpicz, Florian, Stelz, Christoph, Sanders, Peter
Format: Article
Language:English
Subjects:
C++ (programming language)
High level languages
Libraries
Memory management
Message passing
Parameters
Rapid prototyping
Software development
Sorting algorithms
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:The Message-Passing Interface (MPI) and C++ form the backbone of high-performance computing, but MPI only provides C and Fortran bindings. While this offers great language interoperability, high-level programming languages like C++ make software development quicker and less error-prone. We propose novel C++ language bindings that cover all abstraction levels from low-level MPI calls to convenient STL-style bindings, where most parameters are inferred from a small subset of parameters, by bringing named parameters to C++. This enables rapid prototyping and fine-tuning runtime behavior and memory management. A flexible type system and additional safety guarantees help to prevent programming errors. By exploiting C++'s template metaprogramming capabilities, this has (near) zero overhead, as only required code paths are generated at compile time. We demonstrate that our library is a strong foundation for a future distributed standard library using multiple application benchmarks, ranging from text-book sorting algorithms to phylogenetic interference.
ISSN:2331-8422
DOI:10.48550/arxiv.2404.05610