Communication overlap in multi-tier parallel algorithms

Hierarchically organized multicomputers such as SMP clusters offer new opportunities and new challenges for high-performance computation, but realizing their full potential remains a formidable task. We present a hierarchical model of communication targeted to block- structured, bulk-synchronous app...

Full description

Saved in:
Bibliographic Details
Main Authors: Baden, S.B., Fink, S.J.
Format: Conference Proceeding
Language:eng ; jpn
Subjects:
Aggregates
Application software
Bandwidth
communication overlap
Computer science
Concurrent computing
hierarchical parallelism
KeLP
Message passing
multi-tier parallel computers
Parallel algorithms
Parallel processing
SMP clusters
Software libraries
Online Access:Request full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Hierarchically organized multicomputers such as SMP clusters offer new opportunities and new challenges for high-performance computation, but realizing their full potential remains a formidable task. We present a hierarchical model of communication targeted to block- structured, bulk-synchronous applications running on dedicated clusters of symmetric multiprocessors. Our model supports node-level rather processor-level communication as the fundamental operation, and is optimized for aggregate patterns of regular section moves rather than point-to-point messages. These two capabilities work synergistically. They provide flexibility in overlapping communication and overcome deficiencies in the underlying communication layer on systems where inter-node communication bandwidth is at a premium. We have implemented our communication model in the KeLP2.0 run time library. We present empirical results for five applications running on a cluster of Digital AlphaServer 2100's. Four of the applications were able to overlap communication on a system which does not support overlap via non-blocking message passing using MPI. Overall performance improvements due to our overlap strategy ranged from 12% to 28%.
DOI:10.1109/SC.1998.10000