Heterogeneous parallel and distributed computing

Heterogeneous network-based distributed and parallel computing is gaining increasing acceptance as an alternative or complementary paradigm to multiprocessor-based parallel processing as well as to conventional supercomputing. While algorithmic and programming aspects of heterogeneous concurrent com...

Full description

Saved in:
Bibliographic Details
Published in:Parallel computing 1999-12, Vol.25 (13), p.1699-1721
Main Authors: Sunderam, V.S., Geist, G.A.
Format: Article
Language:English
Subjects:
Cluster computing
Heterogeneous computing
Message passing interface (MPI)
Meta computing
NAS parallel benchmark
Networked computing
Parallel I/O
Parallel virtual machine (PVM)
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Heterogeneous network-based distributed and parallel computing is gaining increasing acceptance as an alternative or complementary paradigm to multiprocessor-based parallel processing as well as to conventional supercomputing. While algorithmic and programming aspects of heterogeneous concurrent computing are similar to their parallel processing counterparts, system issues, partitioning and scheduling, and performance aspects are significantly different. In this paper, we discuss the evolution of heterogeneous concurrent computing, in the context of the parallel virtual machine (PVM) system, a widely adopted software system for network computing. In particular, we highlight the system level infrastructures that are required, aspects of parallel algorithm development that most affect performance, system capabilities and limitations, and tools and methodologies for effective computing in heterogeneous networked environments. We also present recent developments and experiences in the PVM project, and comment on ongoing and future work.
ISSN:0167-8191
1872-7336
DOI:10.1016/S0167-8191(99)00088-5