A transmission optimization method for MPI communications

In recent years, MPI has been widely used as a communication protocol for massively parallel computing tasks, and the performance of MPI interprocess communications has become a major constraint for large-scale scalability. By analyzing the performance characteristics of bandwidth and latency of MPI...

Full description

Saved in:
Bibliographic Details
Published in:The Journal of supercomputing 2024-03, Vol.80 (5), p.6240-6263
Main Authors: Wang, Jubin, Zhuang, Yuan, Zeng, Yunhui
Format: Article
Language:English
Subjects:
Communication
Compilers
Computer Science
Interpreters
Numerical models
Optimization
Processor Architectures
Programming Languages
Citations: Items that this one cites
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:In recent years, MPI has been widely used as a communication protocol for massively parallel computing tasks, and the performance of MPI interprocess communications has become a major constraint for large-scale scalability. By analyzing the performance characteristics of bandwidth and latency of MPI communications, a transmission optimization method for MPI communications is proposed. For the variables of transmitted data, the communication strategy of MPI is optimized according to the data size and the succession of multiple communications, and the operation of packing or unpacking is automatically selected, which makes the performance of MPI communications significantly improved. For the time-consuming parts of MPI communication in the ocean numerical model Parallel Ocean Program with this method used, at least 2.4x speedup in point-to-point communication with unpacking strategy and at least 1.7x speedup in point-to-point with packing strategy are achieved. By automating file scans and analysis, 1.6x speedup is achieved for some point-to-point communications.
ISSN:0920-8542
1573-0484
DOI:10.1007/s11227-023-05699-x