Design and Evaluation of primitives for Parallel I/O

It is shown that the performance of parallel file systems can vary greatly as a function of the selected data distributions, and that some data distributions can not be supported. The authors have devised an alternative scheme for conducting parallel I/O, the two-phase access strategy, which generat...

Full description

Saved in:
Bibliographic Details
Main Authors: Bordawekar, R., del Rosario, J. M., Choudhary, A.
Format: Conference Proceeding
Language:English
Subjects:
Bandwidth
Computer systems organization > Architectures > Distributed architectures > Grid computing
Computer systems organization > Architectures > Parallel architectures
Computer systems organization > Architectures > Parallel architectures > Multicore architectures
Computer systems organization > Architectures > Serial architectures > Superscalar architectures
Computing methodologies > Modeling and simulation > Simulation types and techniques > Massively parallel and high-performance simulations
Computing methodologies > Parallel computing methodologies > Parallel programming languages
Concurrent computing
Distributed computing
Ducts
File systems
Hardware
Hardware > Communication hardware, interfaces and storage
Parallel architectures
Parallel programming
Runtime
Scalability
Software and its engineering > Software notations and tools > General programming languages > Language types > Parallel programming languages
Software and its engineering > Software organization and properties > Software system structures > Distributed systems organizing principles > Grid computing
Online Access:Request full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:It is shown that the performance of parallel file systems can vary greatly as a function of the selected data distributions, and that some data distributions can not be supported. The authors have devised an alternative scheme for conducting parallel I/O, the two-phase access strategy, which generates higher and more consistent performance over a wider spectrum of data distributions. They have designed and implemented runtime primitives that make use of the two-phase access strategy to conduct parallel I/O, and facilitate the programming of parallel I/O operations. They describe these primitives in detail and provide performance results which show that I/O access rates are improved by up to several orders of magnitude. Further, they show that the variation in performance over various data distributions is restricted to within a factor of 2 of the best access rate.
ISSN:1063-9535
DOI:10.1145/169627.169782